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ABSTRACT 



A three-volume series describes the construction of 
a self-instructional system as a work process with three main phases: 
system analysis, system synthesis, and system modification and 
evaluation. After an introductory discussion of some basic principles 
of instructional programing, this first volume focuses on the system 
analysis phase, describing some, major sub-phases within the program 
construction process- The current trends in the choice of areas where 
instructional programing may be used are identified. A systematic 
method of determining instructional goals is recommended: first 
searching for goals with empirical and comprehensive means, then 
focusing on goals which are behavior oriented and non-conflicting, 
and, finally, adjusting goals in a series of successive, 
post-checking revisions. The necessity for an analysis of the special 
characterist ics of the intended student population and the external 
restrictions on the use of the study material is stressed. Some 
procedures for examining the logical and psychological structure of 
the subject matter are presented. The mechanical and non- mechanica 1 
devices available to present an instructional system are described 
and evaluated, including programed texts, closed-circuit television, 
and teaching machines. See also volume two (EM 009 073) and volume 
three (EM 009 074). (UY) 



E0051674 



U.S, DEPARTMENT OF HEALTH, 
EDUCATION & WELFARE 
OFFICE OF EDUCATION 
THIS DOCUMENT HAS BEEH REPRO- 
DUCED EXACTLY AS RECEIVED FROM 
THE PERSON OR ORGANIZATION ORIG- 
INATING IT POINTS or VIEW OR OPIN- 
IONS STATED DO NOT NECESSAP'LY 
REPRESENT OFFICIAL OFFICE OF EDU- 
CATION POSITION OR POLICY 



SYSTEM ANALYSIS IN INSTRUCTIONAL PROGRAMMING: 

THE INITIAL PHASES OF THE PROGRAM CONSTRUCTION PROCESS 



ThTs* d o cume n t was processed for the ERIC Document Reproduction Service by 

the ERIC Clearinghouse at Stanford. We are aware that some pages probably 

will not be readable in microfiche or in a hardcopy enlargement. However, 

this is the best available copy, and we feel that the document should not 

be withheld from interested readers on the basis of these u nread able ^alo^^j 



Ake Bjerstedt 



The construction of a self-instructional system can be seen as a 
Work process with three main phases: (1) System analysis: 
Preparatory work (focusing on various ^*pre-requisites** for the 
particular instructional situation or on analyses of various 
components, later to be synthesized into a system); (2) System 
synthesis: Construction of a preliminary system version; and 
(3) System modification and evaluation: Post construction control 
and improvement. - After an introductory discussion of some 
basic principles of instructional programming, the present 
survey focuses upon phase 1 in the program construction process, 
describing some major sub-phases within the preparatory 
work. 
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1. INTRODUCTORY POINTS OF VIEV/ 

1. 1 NOTES ON THE CURRENT SITUATION 

Self -instruc tional study material became during part of the 1960'’s - 
not least in the USA - a focal point of educational interest in a manner 
that few could hav. im igined only a few years earlier. The large pub- 
lishing houses fou;',i\l to be first on the market with new educational pro- 
grams. Schools^ industries and military departments sent their re- 
presentatives to attend information courses and seminars. Both the edu- 
cational and the daily pre;^s were flooded with informative articles and - 
equally often - various statements o-^ opinion. Now the situation has 
partly changed; thc' iiausso of interest is not so marked any more, the 
commercial cUiirns not so vociferous. This does not mean, however, 
that there is no interest for the new techniques or that they have been 
rejected. On the contrary, all over the world work is going on - both 
in rese; ch and in practical product development - using the basic prin- 
ciples ( programmed instruction. The experts in the field have in- 
creased both in number and in expertise, and - as is so often the case - 
some of thc problems have proved to be more complex that some of the 
first enthusiasts believed. 

The construction of self-instruction material, the so-called "pro- 
gramming", is still somewhat of an art, even though it may also be 
part of a scientific activit , relying on patient and detailed research. 
Educational and psychological science has been especially made use of 
in two respects: on thc one hand, as a general source of inspiration, in 
that many of the basic principles can be said to be generalisations of 
learning -p sychological experiences, established in psychological labo- 
ratories; on thc other hand , as supplier of a systematic method for 
assessing the results obtained. The possibilities of basing what lies 
between - the special technique for converting principles into detailed, 
concrete study material - on scientifically based knowledge have been 
far more restricted. 

Fortunately, self -instructing material in its hitherto most usual 
form possesses some few characteristics that encourage us to hope that 
such moments of uncertainty will gradually - at least to a certain de- 
gree - disappear. For it is the self -instructing material more than 
any other kind of study material that preserves the individual reactions 
of the student. And it is the champions of so-called programmed 
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education who more than any other group of study-materia) -constructors 
have emphasized tlie importance of constructing the material by means 
of a series of successive approximations guided by concrete student 
reactions . 

There is reason to suspect tliat many of the special v/ork techniques 
now applied are whims of fasliion rather than rules based firmly on 
educational experience. Indeed, v/e may feel a certain arc:iety that such 
whims of fashion can by reason of their v/ide scope within the intensive 
information activity (where persons with little grounding in educational 
psycholo|^ appear, after a short "workshop”, as independent pro- 
gramrriLng experts and preachers of the right faith) acquire more the 
charactea: of definitive and final truth tlian was intended by their 
originators . 

But on the basis of the above-mentioned qualities - " the continua l 
reaction -re cording " as well as tlie ‘ ' succ es sive re suit -adaptation" 

- the adherents of programmed instruction have built a s elf - 
controlling mechanism . A program-constructor may start from a 
particularly crazy special idea; if he only follows the principle of 
successive approximation guided by factual results, he will be com- 
pelled to correct laimself. It is not impossible that this relatively 
unique feature in tlie self-instructing study-material will at the same 
time facilitate a revival of learning psychology on the basis of data 
from natural learning sitrations. V/e could then perhaps finally pension 
off the hungry rat and the meaningless syllable as the leading sources 
of Icn owl edge about human learning. 

Even though work during the 1960*s has taught us more about how 
human learning is promoted in self-instructional situations, our luiow- 
ledge is still rather limited on many issues. several respe cts, 
therefore, a survey of the present Idnd will be of a preliminary, interim 
nature. Our hope is tliat a systematic inventory among other things may 
serve to give impulses to persons interested in taldng part in the con- 
tinued research and development activities. 

1.2 SELECTION AND TRAIjNVTIG OF CONSTRUCTORS 

Who is to carry out the consi -uction work, the drawing up of the 
auto -instructional study material? Here opinions differ sharply. At 
one extreme there are tliose who hold tliat only qualified, educationally 
and psychologically trained investigators should perform such construe- 
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tion work. At tlic other extreme are to be found those who opt mils tically 
believe tliat the students in the elementary school can be allowed to 
construct their own course material! 

The answer depends, of course, to a certain extent on what is 
understood by tlie terms "construction" and "programming", respec- 
tively. I shail subsequently argue tliat in such discussions it is impor- 
tant to consider a construction procedure in a broad sense. In a narrow 
sense , progran'uning involves the composing of a series of tasks and 
their arrangement in what one believes to be an instructionally app- 
ropriate series following certain special principles. In the broad sense 
programming comprises, in addition to the above, comprehensive 
preparatory work aimed at, among other things, the examination of 
goal -setting and subject-matter analysis as well as comprehensive 
following -up with successive testing and revision of the first version. 

Only if the latter, more comprehensive procedure is followed, 
have the inlierent possibilities of instructional rationalisation been 
fully exploited. Should we stop at the first-mentioned procedure, v/e 
run the risk of getting caught up in less efficient routines. Unfortunate- 
ly, many of the programs that are now being marketed do not build on 
much more than tliis narrov/ procedure (since this, from the point of 
view of the r.ival publishers, takes the shortest time). This fact is, 
of course, no reason for anyone to deprive himself of the advantages 
to be derived from a more adequate working method. 

In a complete coi st ruction procedure, teamwork would seem to 
be the best solution in the majority of cases. As a rule it is probably 
easier to teach a physics - or language -teacher programming than 
to teach a prograinmer physics and Russian. The main part of the 
actual program composition should visually be able to be carried out 
by a person with good special-subject lcnov/3.jdgc as well as teaching 
experience (an instructor and special -subject expert). 

This expe rt -instructor must, firstly, have taken a course in the 
principles of programming, and, secondly, have constant access to an 
educational -psychological expert for consultation. Botli the preparatory 
and the following -up phases involve many tedious tasks that do not have 
to be carried out by pedagogically qualified staff. As a rule, however, 
this work should be planned and led by instructional exports with access 
to special-subject expertise. The result can be a set-up of the following 
kind: 
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!• Preparatory work: 

Led by expert in instructional technology 
Carried out by special-subject expert 

II. Composing the basic version: 

Carried out by instructor and special-subject expert with s^Decial 

training in programming principles 

Supervised by educational -psychological consultant 

III. Testing and revision: 

Led by educat ional -psychological expert with statistical schooling 
Carried out by instructor and special- subject expert with assistants 
for writing and calculating work 

The most time - consuming work in this model is carried out by 
the special-subject expert -instructor . The educational-psychological 
expert - an academically trained psychologist or pedagogue with pro- 
gramming as speciality - devotes comparably loss time to detailed 
work» but on the other hand leads and supervises the project at all 
stages. As a rule, it is only natural to take the special-subject expert- 
instructor from the "purchaser institution", i. c. the school type, the 
firm or the organisations which will eventually make use of the course. 
The educational- psychological expert can be a consultant from some 
external organisation, if the organisation in question has not in its own 
ranlcs access to a person with these qualifications. 

Another conceivable possibility is to take both special- subejet 
expert-instructor and educati onal -psychological expertise from outside 
the purchasing institution for a definite assignment, i.e. , to "package- 
order" a certain course from an institute for programming. In viaw of the 
fact that tlie purchaser gets less insight into the work and less possibility 
to influence its sliaping, and seeing that the school, firm or organisation 
cannot make use of its learning for further projected courses, this lat- 
ter "paclcage model" will often turn out to be more expensive for the 
purchaser. A great deal naturally depends on the personal resources, 
and hence recommendations that are valid in all situations can scarcely 
be given. 

In selecting persons within the organisation attention dhould be paid 
to a variety of factors. Persons should naturally - as h^s already been 
stated - be experts in the special- subject sphere , and they .ould prefe- 
rably also possess teaching experience (in the special-subject field in 
question and with students of the kind to which the auto- ins tructional 
material is directed). 

Certain personal qualities should facilitate this work. Hero especial- 
ly belong analytical ability and ability to express oneself clearly and 
with simplicity in writing. A good deal of enthusiasm for the task, a 
large dose of patience mixed with a dash of "perfectionism" sho^ild 
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also facilitate this time - and energy-consuming work. It is often an 
advantage if two persons work simultaneously in the same course field. 
They cen thus check each others work and by mutual discussion reach 
the most satisfactory solutions. 

The special -subject experts and ceachers, who will take part in 
the construction work, must of course have a certain basic training in 
the principles and technics of programming . Some experience from 
such training, perhaps a 2 -4 weeks'* intensive course, comprising (a) 
a survey of general principles and of various techniques thus arising, 

(b) examination of sample good and bad programs, and (c) construction 
and discussion of on'‘..''s own practice material, would serve as a good 
point of departure. Naturally the individual conditions varv, and much 
of the subsequent work must, in all circumstances, take place under 
careful supervision and thus at the same time entail further training. It 
would be advantageous if the survey of principles and techniques could 
be made with the help of a written manual, to which reference can be 
made, and which can serve as a recapitulation aid and summary. This 
is one of the purposes behind the present book. 

Efficiency in the subsequent work is of course intimately connec- 
ted with tile educational -psychological e^zpert^s skiE as study leader and 
consultant. His learning-psychological and general pedagogic background 
should be some guarantee that he will not get entangled too easily in 
stereotyped routines, that be can keep an eye open for alternative solu- 
tions and new instructional techniques, and that he is able to look upon 
individual procedures not only a'^ ingenious contrivances but also as 
special applications of more general learning principles. 

At the same time, however, he must endeavour to follow up what 
is happening in his rapidly expanding field so that he can become a 
progressive rather than a status-quo factor in the pedagogic team-work. 
He should build up a library of the most important general -survey publi- 
cations and subscribe to some of the international periodicals which 
publish the latest research reports and current discussions. A few 
preliminary tips arc given in the bibliographic guide given in Appendix 
II belov/, the main contents of wliich the special- s ubject expert should 
be acquainted with. 
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2. SOME NOTES ON BASIC PRINCIPLES 



By ’'self-instructional study-material" wc here refer to a study- 
material that in no way postulates a teachcr^s continuous engagement 
in subject-matter organization, the detailed presentation of subject- 
matter or examinations, and that in its arrangement endeavours to 
follow certain principles (partly based on communication theory and 
the psychology of learning) in order both to make such self-instruction 
possible and generally to promote the e^f •^ctivencs s and efficiency of 
the instruction. 

In the present section we shall briefly present some general 
background arguments together with some notes on the basic principles 
which have hitherto often been followed in the construction of self- 
instructional materials. Some of these principles arc of a very general 
character, others arc more specific. Some arc relatively generally 
accepted, while on others opinions are more divided. Continued work 
witli self-ins tr uctional materials will probably in due course provide 
us with a better knowledge of the durability and general validity of 
the various background principles. Some of these background principles 
will probably have to be modified or given a more specific shape. 

2. 1 SOME COMPONENTS IN AN INSTRUCTIONAL SITUATION 

It may be appropriate to start the discussion by trying to outline some 
main components of a typical instructional situation. First, it may 
perhaps be tempting to give the outline the following simple form: 



Presented 




Student^ s knowledge 


instructional subject-matter 


0 


(received instructional 


("stimuli") 


s u b j e c t - ma tte r ) 



Figure Z, 1 

But the student, of course, is not a container which can thus easily be 
filled with knowledge. We understand that the outline gives a far too 
simplified picture of the Icnowledge-impar ting process, seeing that it 
does not take into consideration the fact that the ability of different 
persons to "receive" material varies - owing to, among other things, 
dissimilarities in previous experience and a fluctuating degree of 
attention at the specific moment of instruction. Thus, we could 
schematically irr»agine the individual student as a receiver with, for 
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various reasons, a reduced receiver-capacity at the moment of 
instruction or as a ’^knowledge -filter" that only retains part of the 
instructional material presented: 




JA certain knowledge waste 

Figure 2, 2 

Our outline, however, still only includes some very crude main 
components in the instructional situation. The external stimulus 
situation contains some other elements in addition to the specific 
subject-matter to be learnt. Some of these facilitate the lea.rning (as 
remedial information, certain instructions for behavior and 
stimulating evaluations), other elements are relatively neutral for 
learning (a number of environmental elements), whereas others 
again render learning difficult (disturbing environmental elements 
such as noise or interest-diverting "distr actor s ") . The "external 
stimuli" can thus be divided up into intended information material 
(or "focal" stimuli) and stimuli of other kinds. 

Similarly, the student^s "receptive capacity" is a complex 
phenomenon: it depends partly on special experiences O'-d expec tati^^ns 
in the now- situation, partly also on certain more general reaction 
tendencies, deriving from earlier experiences. 

Finally, we must pay attention to the fact that what is really 
learnt in the instructional situation is often not only specific informa- 
tion (knowledge of specific subject-matter), but also more general 
action- and experience -tendencies (study techniques, attitude to the 
special- subject field and so forth). 

These discussions lead, in other words, to a further re -ar rengement 
of our figure : 
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External stimuli; 



Proc css; 



Learning results; 




Specific 
retained 
total know- 
ledge 



* 'Second -order 
learning"; study 
techniques, 
attitude s , etc . 



Figure 2. 3 

In order to be able to carry out a closer analysis of the effectiveness 
and efficiency in such a "communication system", we should, however, 
make at least a few more sub-divisions so that certain important 
elements should not be forgotten. We will then arrive at an outline 
of roughly the appearance seen in Figure 2.4. At first sight this 
outline perhaps looks terrifyingly complicated. A comparison with 
Figure 2. 3 and a study of our subsequent commentaries should, 
however, make it easier to understand. 

Let us first examine the " s timulus " end. By this we mean the 
external incitement or influences of various kinds that affect the 
student in the instruction situation. Here, of course, the " focal 
informative stimuli " arc of cardinal importance; these are the elements, 
tlic very information units that we v/ish our students to acquire. They 
constitute the focus of the instructional situation, whether they be 
presented in the shape of tasks in the teacher's oral presentation, of 
data in a book, or of information provided by a tape-recorder or a 
film. 

Besides these "focal stimuli" we usually have others, which are 
essential for learning: accompanying information (not intended to be 
learnt, but rather to. elucidate further or to facilitate the learning 
of the focal subject-matter), supporting evaluations and instructions 
closely related to the subject-matter (furnishing the student with 
directions as to how he should behave in a certain instructional situation 
or as regards certain parts of the presented subject-matter). Wc can 
call these stimuli " correlative " in order to make clear that they stand 
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A. '* External stimuli” B. '‘Hypothetical "External response reactions”: 

internal process”: C. Immediate: D. Delayedr 




Figure 2« 4 An hypothetical sketch of an instructional situation. (For more detailed 
explanation of outline, see text.) 
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in a certain systematic (^’accompanying”) relationship to the actual core 
of the subject-matter. On similar grounds we might speak of them as 
"systematic environment". The remaining stimuli in tlie situation then 
form the inevitable "non- systematic environment", comprising all 
otlier factors in the immediate surroundings (possibly persons present, 
miscellaneous objects in the vicinity and such circumstances as light, 
humidity, temperature, traffic noise etc.). 

Let us for the present skip the hypothetical "inner processes" 
and instead look at the observable external reactions. V/hat we 
directly get an idea of is the immediate response reactions: correct 
and incorrect actions in the instruction situation. What we are most 
interested in, however, is of course not these short-term effects 
but instead the " delayed" reactions: the long-term effects or such 
student reactions as indicate a certain residue of knowledge in an 
application situation on a later occasion. 

In tlic outline we have given three different ways in which such 
"retained total knowledge" might show itself concretely, namely, 

(a) correct behavior in a situation with a minimum of external 
guidance, (b) correct behavior in a well-defined choice situation 
(where the main task is to choose the correct alternative from a 
series of given choice possibilities), and (c) ability for quicker re- 
learning of subject-matter which cannot be spontaneously activated. 

The first case entails the highest degree of residual knowledge, the 
last case the lowest. 

What we previously calle d "second-order learning" has here been 
sub-divided into three categories: teaching effects regarding (a) the 
student^s study techniques (the student may have acquired a good 
study technique, even if he cannot himself activate the special- subject 
xnaterial itself), (b) his attitude to the special subject in which he has 
been instructed (he has perhaps a good residue of subject-matter but 
has acquired such a negative attitude to the subject that he will never 
voluntarily take an interest in it hereafter), and (c) his general 
attitude to the acquiring of Icnowledge on the whole (ranging from the 
view that study is a privileged pleasure to that of study being some- 
thing only to be done under direct coercion). 

The intermediate links between external stimuli and final reaction 
- the hypothetical inner processes - cannot be observed by us in the 
saine direct manner. But we can study different persons^ descriptions 
of how they experience tliese processes, and, indirectly, we can draw 
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certain conclusions about them on the basis of experiments and 
correlative investigations. 

We can imagine that the exy>erience in the now- situation comprises: 
partly , a relatively ** pure*' experience of both focal and non-focal 
stimuli (i.e., an experience minimally influenced by factors other 
than the stimuli themselves); partly , a series of expectations (created 
by, among other things, such - previous - experiences) as to what 
shall farther be presented or as to certain connections between 
different informational units; partly , also an emotional experiei.ee 
of the subject-matter and other parts of the learning situation. 

Usually, we can only separate these elements in theory. In most 
situations the interplay between them is in all probability very close. 

It can, for instance, be extremely difficyilt to differentiate between 
expected experience and "pure" experience, something that occasionally 
is expressed in "incorrect perceptions" on the basis of keen (but 
unjustified) expectation. Often, in this connection, expectation has both 
a selective and a reshaping (simplifying, sharpening) function. 

Experience in the now- situation is, in addition, influenced by the 
student^s general experience -background and the more permanent 
characteristics of his personality , e.g., by the student^s specific 
pre-knowledge, general ability, motivation and other special 
characteristics. Certain persons can, for instance, by their personal 
disposition be more inclined, quite unthinkingly, to attach more 
importance to the element of expectation than to the recording of 
unexpected external experiences, whereas others - just as unthinkingly 

- are more disposed in the first place to pay attention to the realities 
of the external situation. 

The construction of self-instructional stu \y-rmitcTi 2 il starts from 
the general aim of creating an effective learning situation . By 
"effective" we generally mean a situation in which, starting from the 
goal definitions, an optimal combination of behavioral products 
(column D in Figure 2.4) is obtained in a minimal period . In shorter 
courses with well-defined proficiency content this usually indicates 

- to use a somewhat different formulation - a learning situation in which 
the greatest possible quantity of the "focally informative stimuli" 

is retained as easily activated total knowledge in the student as the 
result of a process entailing a minimum of time -consumption and a 
minimum of non-*desirable side-effects (for instance, negative 
attitudes) , 
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In order to be able to make an assessment of a certain situation's 
effec tivity we must necessarily (a) clearly state in advance the scope 
and content of the desired total knowledge with a specification of the 
ac tualisation type (e. g, , alternative D. 1 or D. 2 in Figure 2. 4) and (b) 
decide upon certain tolerance limits for time -consumption and negative 
side - effec ts , In certain cases, for instance, the question of time is 
of subordinate interest, and the demand is for a complete mastery 
of a certain behavioral repertoire. So, for instance, the driving- 
licence candidate must train until he reaches a certain acceptable 
level of performance, regardless of how long this takes him. In other 
cases we only have a limited amount of time, and it is a question of 
fitting within this time -frame as great a total knowledge as possible 
within the given field. This is often the case within the framework of the 
compulsory school. Again, in other cases, it is a question of finding 
the optimal balance between time -consumption and acquired subject- 
matter so that the learning procedure is broken off at a point in time 
when further proficiency learixing would entailusing - according to certain 
criteria - a disproportiona.tely large period of time. 

When assessing learning effectivity it is of course (as pointed out 
in our general definition of effectivity) important to pay attention to 
all links in the teaching product (cf. column D in Figure 2, 4) and 
decide in advance which sub-part (or sub-parts) is the most essential 
in the event of their coming into conflict with one another or being to 
different high degrees encouraged by different instructional procedures. 
Instructional rationalization must not of course trample on the 
acquired work techniques or s tudy- attitude s , in the cases where these 
aspects are essential to the goals defined for the specific teaching 
area . 

In this respect there is very often a certain difference between 
shorter training courses for a certain specific post and the more 
generally oriented training, which, for instance, takes place in the 
compulsory school. In the former case the goals are comparatively 
specific and the total knowledge in consequence relatively well-defined 
or at least in principle easy to define. In this case the instructional 
rationalization can move ahead rather strictly, cutting away irrelevan- 
cies and focusing upon the specific proficiency goals. In other cases 
- as in the compulsory school - the goal area is considerably broader: 
many would agree that for several subjects the work techniques and 
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the general attitude to learning are often more important than the 
particular factual subject-matter, which can easily be activated by 
the student at a certain time. In such a case, the effectivity definition 
should also clearly state this in terms of goal priorities so that one 
does not in ignorant and one-sided rationalizing zeal rationalize away 
just that which one most wanted to gain. An effectivity assessment 
without a goal analysis is in all circumstances impossible. 

2. 2 SOME BASIC PRINCIPLES FOR SELF- INSTRUCTIONAL AIDS 

Let us in a few points briefly state the means by which, when construct- 
ing self-instructional study material today, we endeavour to increase 
effectivity in communication and teaching. 

1) By a detailed goal analysis we attempt to clear away ir relevancies 
so that we can clearly c oncentrate on the "focal** informative stimuli 
(’’total focusing") essential to the objectives. 

2) By a penetrating analysis of the structure of the subject-matter 
we facilitate a break-down of the subject-matter into appropriate 
presentational units , which still further contributes to the focusing, 

the directing of attention on the central information ("itemized focusing"). 

3) The analysis of the structure of the subject-matter also makes 
possible better planning and more adequate decisions on sequences 
which facilitates the teaching. In making a sequential decision we pay 
attention to, for instance, such general principles as that more 
complex proficiencies arc; built up on the basis of more elementary 
ones; also, systematic repetition is built into the study material itself 
(and therefore not entirely handed over to the student^s own initiative 
or lack of same). 

4) By a systematic use of "correlative stimuli " in the earlier stages 
of the learning process we make certain that the correct "expectation" 
is created in the student so that he swiftly succeeds in finding the 
correct solution. This generates an early training of correct behavior 
(instead of early incorrect behavior with subsequent risk for a more 
time-consuming training process). Usually it also generates an 
emotionally positive experience of having succeeded, which in many 
cases acts in an allround stimulating and "motivation-increasing" 
manner . 

5) By a successive "fading " of these accompanying support- stimuli 
during the progressive learning process we make certain that the stu- 
dent learns to fulfil his task "on his own" (without having to suffer too 
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many defeats on the way to this goal). 

6) By the above-mentioned steps, which all have to do with the 
’'stimulus", we do everything possible to prevent irrelevant stimuli 
from being woven into tie course material. By special arrangements 

- machine presentation or special types of book presentation - we often 
also endeavour to prevent the student from taking such liberties with 
the material that the projected planning is destroyed. 

7) By careful advance-analysis of the course material's normal 
public - the so-called " target population " - we try to get to know 
the students; for instance, their common prc -knowledge, reading 
ability and special characteristics, so that effectivity in communication 
becomes optimal (tasks neither toe difficult nor too easy). 

8) Knowing that learning becomes more effective when the speed 
with which the information is imparted can be adapted to the individual, 
we arrange the learning situation in such a way that the student is 
allowed to work at his own tempo . Thus we prevent both the slow 
student losing important information, and the quick one being bored 

to death. The not uncommon average -centered or somewhat-below- 
average-paced instruction is thereby replaced by a more individual- 
centered technique. 

9) In cases where this speed-individualization does not seem 
sufficient to neutralize the inequalities in the students^ experience- 
backgrounds and personalities, we build some branching technique 
into the program. This entails in principle that certain students (on 

tlie basis of their performances or attitudes when at work) are streamed 
along special routes through the study material. This, for instance, 
can mean that a student v/ith a higher level of pre -proficiency can 
take a "shorter route", that a student with a lower level can take a 
"longer route" with more repetition, or that a student who lacks 
certain special pre-knowledge gets a little built-in "remedial course" 
to repair the deficiency in question. Branching can also be shaped 
in such a way that students with different views or attitudes can 
study different exemplification materials or be confronted with varied 
types of argumentation in order to cittain by different, individually 
adapted routes the same conclusions in principle. Finally, we can in 
certain cases arrange the material in such a way that the student on 
certain points may himself choose whether he will have a question 
further clarified by going through a "higher course section" 

("voluntary branching"). 
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10) Since learning is more effective when the "flow of information" 
is always met by active attention, the teaching situation is usually 
shaped in such a way as to exploit the " student-steered stream of 
information " . The information does not then continue to flow (as, for 
instance, is the case during a lecture or at a conventional lesson 

in a class), if the student relaxes his attention, "goes to sleep" or 
must go to the dentist, Y/hen he concentrates again, "wakes up" or 
returns from the dentist, ha can, in other words, continue where he 
left off and has therefore not missed any important links in the thought- 
chain, 

11) In order further to ensure that his attention shall not slacken, 
wc usually arrange the study material in such a way that the student 
is compelled to give " external r e sponse - re actions " at short intejrvals 
and in immediate association with the individual presentation-units. To 
read pen in hand has been an old study-technical tip. In programmed 
study material the activity principle is built into the system, 

12) V/ith the aid of a " successive feedback technique " the student is 
most often immediately allowed to know whether his response reaction 
is correct or incorrect. In addition to its attention-promoting effect 
this procedure has certain other advantages. If the student has acted 
correctly (which is usually the case due to the carefully planned step- 
by-step presentation-manner), he not infrequently receives an unambi- 
guous progre s s -experience which increases his pleasure in working. 

If, on the other hand, he has acted wrongly, he is at once corrected, 
and the likelihood of the wrong response tendency being retained is 
therefore lessened. 

13) If the incorrect responses are of some fundamental importance 
("systematic" errors), and if sufficient correction does not automati- 
cally occur in the following work sequence, special remedial instruc - 
tion can be built in. (Remedial instruction of this kind is in its quality 
of both "micro-branching" and "extended feedback" more or less a 
special case of both points 9 and 12. ) 

14) At the end of the study material or after certain part- sections 

of the study material wc usually build in te s t-tasks giving a preliminary 
idea of the retained total knowledge and the acquired work-technique, 
and which at the same time demonstrate to the student what he has 
learnt. 

15) The student's immediate external response reactions in the 
course of the instructional process have significance not only as activi- 
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ty- promoting devices, but also as permanent reaiction data for later 
successive analyses. Thus they can be used for diagnostic information 
about the student^s continued need of supporting material or his 
ability to benefit from more advanced study material. But they can 
also be used as a basis for further effec tivisation of the presentation- 
units or the reshaping of the presentation- sequence. The latter mode 
of use is in itself a central point in the construction of self-instructional 
study-material. The student^s reactions (both the immediate ones 
during work as well as the delayed ones, v/hich give us information 
as to tlie retained total knowledge) are the final indicators of the 
study-material^s effectivity. Continuous testing and revision under 
the guidance of the student^s reactions constitute therefore a normal 
phase in the work of construction. 

The above fifteen points can be said to summarize some of the 
main characteristics distinguishing an effective s elf- instructional 
study material. Several of these characteristics also describe an 
effective instructional situation in general. It is obvious, for instance, 
that a detailed goal analysis and a revision of tlie pro sentation -forms 
on the basis of the student^s reactions also constitute important 
factors which promote effectivity in the usual classroom instruction. 
Hitherto it has been the champions of self-instructional study 
material who have most strongly stressed the value of applying 
procedures of the kind outlined here. The reason - among others - 
is that the demands on th< self-instructional material's clarity, 
unambiguity and effectivity must always be placed on a high level, 
seeing that the possibility of more improvised improvements and 
clarifications when required, as offered by conventional classroom 
instruction, does not exist in the self-instructional situation. 

The above fifteen points should be examined by the reader both 
in relation to the hypothetical outline of an instructional situation as 
given above (Figure 2. 4) and as a background to the following concrete 
survey of different stages in the construction work. The first six 
points deal mainly with '* tlie stimulus side* ' (column A in the figure); 
points 7-9 touch on the adaptation to the inner process, especially 
the student^s varying background- experience (column B); points 10 - 15 
mainly refer to * *the reaction side ** (columns C and D in the figure). 

Of course, much of what has been said above - for him who is not, in 
advance, at home with the special nature of the self-instructional aids 
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- may appear slightly abstract. \le hope, however, that the more 
detailed presentation below will make our points of view much more 
concrete and clear. 

2. 3 DIFFERENT MOTIVATIONS FOR THE USE OF SELF- 
INSTRUCTIONAL STUDY-MATERIAL 

We can choose self-instructional study-material for different 
reasons. Some common motives are the following: (a) An insufficient 
number of teachers at several places where instruction in a certain 
subject-matter is needed, (b) The habit of working on one's own 
with self-instructional study-material is considered important for 
the student^s study technique and training in independent work. 

(c) The possibility of differentiating work-pace is considered 
essential in heterogeneous classes with sharply varying background 
conditions for the students, (d) The self-instructional study material 
is considered a more rational and effective instrument, which leads 
more quickly to intended results. 

All points of departure are of course valid in different connections, 
but the reasons must be explicitly clarified, as different motives can 
and should lead to certain shifts in the centre of gravity in construction 
work. 

Thus, the fourth of the above-mentioned points of departure, d, 
places the greatest emphasis on rationalization and effectivity. In 
tliis case the clearing away of irrelevant stimuli and the study of 
time -consumption and retained total knowledge are particularly 
essential. Here comparative investigations of effectivity in different 
forms of instruction are of obvious interest. Seeing that efficiency is 
of focal importance, the self-ins ' rue tional technique should not as 
a rule be applied in cases other than those which arc really proved 
to lead more quickly to the goal than alternative instructional forms. 
These lines of thought often apply to shorter adult courses intended 
for special, well-defined training goals. 

The first-named point of departure, a, however, gives a case in 
which alternative instructional possibilities need scarcely be 
considered. It would be rather a question of arranging a kind of 
^^rationalized correspondence instruction". Efficiency comparisons 
with lesson instruction arc hardly relevant in this connection. 

Motivations b and £ would probably be often of importance in the 
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compulsory school. Then ii: is important that wc do not at the same 
time blindly stare at a one- sided interpretation of the effectivity demand 
in terms of subject-matter knowledge learnt. Comparisons between the 
efficiency and effectivity of different work forms is of course always 
of interest, but knowledge effectivity is not the only decisive factor . 

A lower knowledge - effectivity linked with better work*" habits or with 
greater enjoyment of work and pleasanter disciplinary conditions 
would certainly be considered a fully acceptable goal by many teachers. 
Here as elsewhere we must not hesitate to declare what we consider 
to be the most essential - and then keep to the priorities. But naturally 
we must .hen not forget to see to it that the new, not merely know- 
ledge-oriented goal is also realized. In other words: wc must not relax 
our efforts in the conviction that self-instructional study-material may 
be useful for study techniques and work training, but wc must of course 
actively strive to get the material so shaped that there will be favorable 
conditions for this target to be attained - and subsequently we must 
also try to check the result. Certain forms of self-instructional material 
can, for instance, be thought to accustom the students to a far too 
chopped-up and stereotyped spoon-feeding or to guess in g their way to 
their responses rather than thinking them out . A priori is not work 
with all types of self-instructional material of value for independent 
work training. 

2.4 A PARENTHETICAL NOTE ON THE THEORETICAL MODEL 

It has perhaps struck some readers with a knowledge of current 
works on the subject that the a.jove background discussion has not 
contained a single word about animal-psychological studies. Nor have 
we spoken of '‘reward" or "reinforcement" techniques or of the 
successive shaping of existing behaviors - terms and expressions 
that surely play a central part in the discussion about the learning- 
psychological background. For Skinner - outstanding animal psychologist 
and one of the leading exponents of self-instructional study-material 
- it was only natural to formulate the theoretic model in what 
psychologists are wont to call strictly S-R-theoretic teirms and together 
with animal-psychological illustrations. 

In a historical survey this type of argumentation has its place. 

I have also to some extent followed a procedure of this kind in another 
context. But at the same time I think it may be a disadvantage to bind 
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oneself one-sidedly so that one always describes and thinks in these 
categories. The disadvantages arc of two kinds: the one external 
(communication-psychological) and the other internal. 

The external disadvantage is that the animal-psychological 
il..us trations and terms have a tendency among certain listeners to 
rouse an unnecessarily negative attitude in advance which not infrequent- 
ly blocks a continued exchange of thought. The rat-psychological 
perspective thus often becomes an unnecessary communication barrier. 
If the same basic principles can be demonstrated in experience- 
material that lies closer to hand, then there is a lot to be said for 
letting the rat remain in his cage. 

The other disadvantage is of a more fundamental nature. I believe 
- and on this point perhaps many hold another view - that it would be 
unfortunate for the future development of self-instructional study- 
material to bind oneself to a strict S-R-theoretical model. Th?*s point 
of departure has already in a few cases led to surprising formulations 
of experience data and a certain disposition to overlook important 
realities. Different behavioral theories ought probably to be first seen 
as different ways of classifying and describing a variegated reality. 
There is nothing, in my view, that says that experiences and results 
from studies of self-instructional study material cannot be described 
just as well in other terms as in those that are typically Skinnerian. 

Here I have chosen to start from a simple communication- psychologi- 
cn.1 model including cognitive and personality-psychological elements. 

In any case, I myself feel such a point of departure to be more flexible 
and more natural in describing what happens in a human learning- 
situation, and it seems to me to give greater scope for broad 
explorations fruitful for the further development of the method. It 
would also seem to facilitate comparisons between these special in- 
structional forms and other types of human instructional situations. 
Obviously neither the one nor the other model type should be taken 
too seriously. Models are convenient data- summarizers and useful 
sources of inspiration - but they are of course never more important 
than the basis of empirical facts on which they build, and about which 
some sort of agreement is usually relatively easily attained. 
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3. THE THREE MAIN PHASES IN THE CONSTRUCTION OF A SEL.F- 
INSTRUCTIONAL SYSTEM 



The construction of self -instructional material can, of course, be app- 
roached from, many different angles - some of which can be described 
more precisely than others. Concerning the details there is still con- 
siderable disagreement among different schools. On the other hand, re- 
latively good agreement has been reached in principle with regard to ' 
the broad lines, the main phases of the work. The fact that, for reasons 
of time or economy, the complete procedure has not always been fully 
exploited in the concrete tasks, is a different matter. 

The presentation which follows is based on a view of the construction 
process which distinguishes three main phases of the work: 

1. System analysis: Preparatory work 

2. System synthesis: Constructing the preliminary version 

3. System modification and evaluation; Testing and revision. 

The p' eparatory work comiprises all the important work which must 
be done before the constructor can sit down with a clear conscience and 
formulate presentational units intended for direct student work. It in- 
cludes a detailed analysis of the special goals of the instruction, of its 
external conditions in the actual situation and of the special characteris- 
tics of the relevant subject-mi.atter. Certain preliminary decisions as to 
presentational media must also be taken at this early stage. In general, 
the preparatory work focuses upon an ’’analysis" of the components to 
be put together later in the "synthetic" phase. 

On the basis of the results and decisions of the preparatory analysis, 
the material-conLtructor then begins the construction of a preliminary 
version, in which he must also pay attention both to principles for the 
shaping of the individual presentational units as well as to guiding -lines 
for their m.utual arrangement. 

The quality of the preliminary version varies of course coi lerably 
depending on the subject-matter^ s character, the thoroughness of the 
preparatory work and the constructor'" s background experience and gene- 
ral aptitude for the work. The third main phase comprises a gradual 
testing of the preliminary version with successive revisions and a ,'’er- 
minal field-test on representative groups, designed to yield guidance 
and information to the potential user: a kind of "informative label’'. 
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Certain assessments of the scope of the different main phases (cal- 
culated in working -hour s consumed and/or costs) are to be found in the 
literature. Deutsch (1962, p. 211), for instance, calculates that appro- 
25 % of the total investment of time and money is disbursed in prepara- 
tory analyses, approx. 30 % in the constructing of the first version, and 
approx. 45 % in successive tests and revisions. Naturally such statisti- 
cal information cannet be generalized, since the special conditions of 
work in each individual case will create a partly unique situation. The 
scope of the preparatory work varies, for instance, to an extraordinari- 
ly high degree depending on whether any kind of preparatory analysis 
already exists in the shape of detailed course planning or whether the 
constructors are compelled to begin from rock bottom (starting only 
from a general and vague formulation of the instructor'^s goals ). 

Nevertheless, it can be of a certain interest to note the above-men- 
tioned figures. The beginner in the field sometimes has a feeling that 
the main part of the work consists of a direct construction of study- 
material according to a scries of rules of thumb, and that what is here 
called preparatory work and testing together with revision, respective- 
ly, constitutes side activities demanding comparatively little time and 
work. In reality, however, Deutsch estimates that less than a third of 
the total investment is disbursed on such direct construction. (F or a 
more detailed discussion of the economical aspects of work and time, 
see, e. g. , Klaus &: Lumsdaine, 1962; Kopstein & Cave, 1962.) 

As is already obvious from the description of the different main phas- 
es above, several sub -phases have to be dealt with -- for instance, in 
the following manner: 

1 . System analys i s: Preparatory work 

1. 1 Analysis of prerequisites 

1. 1. 1 Choice of subject-matter area 

1. 1. 2 Goal analysis: Decision on terminal points 

1. 1. 3 Student analysis: Clarification of initial points 

1. 1.4 Situation analysis 

1. 2 Subject-matter analysis 

\ 3 Preliminary decisions on media-method combinations 

Z System, synthesis; Construction of preliminary version 

2. 1 Preparatory decisions on sequences and procedures 

2, 2 Working out instructional sub-units, deciding on 

2. 2. 1 Information elements 
2. 2. 2 Response requests 

2, 2. 3 Result indications 

2. 3 Final adjustment of sequences and media 

PA 



3. System modification and evaluation; Post-construction quality - 
control and improvement 
3. 1 Systematic pre-testing examination 
3. 2 Successive testing and revision 
3. 3 Final field testing 
3. 4 Writing of manual 

In the following survey we shall broadly follow the work plan outlined 
here. 
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4. CHOICE OF AREA 
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When an organization or a school begins to consider converting certain 
courses into a self -instructional form, several questions of choice 
arise at the very start. Which fields are the most suitable? In which 
area should we begin? Are there any fields that we should not include ? 

4. 1 TRENDS 

An examination of the distribution of published courses for various 
subject-matter areas may be of some interest in this connection. For 
instance, reference may be made to the early lists of programmed 
courses on the U, S. market, drawn up by the Center for Programmed 
Instruction, New York, or similar lists on programs available on the 
market in Britain, complied for the Association for Programmed Learn- 
ing and Educational Technology, London. 

Table 4. 1 shows that the distribution of subjects in U. S. programs 
for the three years given is fairly similar despite the differences in 
the number of courses avialable. It is easy to sec a tendency towards a 



Table 4, 1 Survey of the distribution of subjects in American program - 
med courses (according to the information available for 
1962, 1963, and 1965) 



Subject 




1962 




1963 




1965 


No. 


. % 


No. 


% 


No. 


% 


Mathematics 


52 


43 


123 


35 


49 


16 


Science 


24 


20 


69 


20 


70 


24 


English 


16 


13 


51 


14 


56 


19 


J^oreign languages 


10 


8 


21 


6 


9 


3 


Social studies 


7 


6 


16 


5 


22 


8 


Business education, 


4 

‘V 


3 


22 


6 


17 


6 


economic s 
Programming 


2 


1.5 


9 


3 


3 


1 


Miscellaneous 


2 


1,5 


41 


11 


65 


21 


Total 


117 




352 




291 





The figures give a content survey of programs available for purchase 
in Sept. 1962, Sept. 1963, and April 1965. The data have been obtain 
ed from the publishers by the Center for Programmed Instruction at 
the request of the Office of Education (cf. ^*Programs, ""62*', "Pro- 
grams, '63", and "Programed instruction materials 1964-'65"). 
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Table Z Survey of the distribution of subjects in programs avail- 
able on the market in Britain in 1969 (according to sub- 
ject classification in Cavanagh &c Jones, 1969) 



A. 


Subject headings with more than 50 titles 




Biological sciences 


99 




Chemistry 


82 




Civic affairs 


62 




Commercial subjects 


91 




Computers 


53 




Earth sciences 


78 




Electricity and electronics 


106 




Engineering 


199 




Engli sh 


130 




Industry 


51 




Management and supervision 


67 




Mathematics 


572 




Phy sic s 


88 




Reading 


57 


B. 


Subject headings with 10-50 titles 




Foreign languages. General subjects. Health education. History, 
Medicine, Nursing, Programmed instruction, Slide rule, Statis- 




tic s 




C. 


Subject headings with less than 


10 titles 




Bridge, Carpentry, Dentistry, 


General science. Librarian ship, 




Linguistics, Logic, Music, Photography, Physical education. 




Religious education 




Total number of programs classified 2004 



Note: The editors have tried to list all teaching programs - both 
industrial and educational - available on the British market in 1969. 
Of the about 2000 titles, most are of British origin (about 1600 
programs); the rest are mainly American programs. In this sur- 
vey, mathematics programs form the largest single subject cate- 
gory, with 572 titles (or 29 % of the total). The second largest 
category is engineering with 199 programs (10 %), and the third 
is English with 130 entries (6 %), - Figures in Tables 4. 1 and 
4. 2 are not directly comparable, since principles of program se- 
lections and classification are somewhat different. 




preponderance of some special subject-matter areas, especially mathe- 
matics and science. It is worth noticing, however, that the relative pro- 
portion of mathematics decreased from 1962 to 1965, Table 4, 2 gives 
a survey of programs available in Britain in 1969. In spite of a consider- 
able breadth of topics used, mathematics and the natural sciences still 
form particularly large sub -categories. 
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Surveys of this kind must not be overrated. What was applicable du- 
ring an early period need not necessarily be applicable later on in a 
field developing rapidly. But a statistical survey of this kind gives us 
some idea of what publishers and course programmers have, up to a 
certain point of time, regarded as the easiest material to convert into 
self -instructional courses. From this, it need not follow, of course 
that other fields are unsu i table for programming. The conspicuous in- 
crease in the number of programs under the heading '’Mio'cellineoun'* ’’ 
in Table 4. 1 indicates that the range widened rapidly to include new 
fields. A quick sample of subject indicators in the index of the 1969 Bri- 
tish list of programs in print testifies further to the diversity: Accident 
prevention. Battle of Hastings, Choosing a job. Decision making. Elec- 
trocardiography, Frost precautions. Growing adult. Hypnotism, Insur- 
ance policy, Julius Caesar. Keybord mastery, Latin, Melodic percep- 
tion, Neurosis, Ohm^'s law. Poetry, Queen and parliament, Roentgeno- 
logYi Smoking, Traffic signs. United Nations, Volcanic activity, and 
Weft knitting. 

4. 2 SOME POINTS OF VIEW IN CHOOSING SUBJECT-MATTER AREAS 

Some points of view that may be taken into account in choosing subject- 
matter areas arc listed below. 

’' Subject-matter points of view *' 

(a) Subject-matter which has a relatively easily distinguishable lo- 
gical structure would seem to lend itself more easily to the usual types 
of self -instructional material than other kinds. It is probably this, among 
other things, that is reflected in the large number of courses in mathe- 
matical subjects, especially during the early period. One might also say 
that mathematics is one of the subjects in which older teaching approach- 
es have certain similarities with the technique of programming (an alter- 
nation of new information, solving problems, result indication). In other 
words, the step from conventional to programmed techniques may be 
said to be shorter in mathematics than in some other subjects. The ad- 
vantages of using subject-matter that has an easily distinguishable logi- 
cal structure are firstly, that structural analysis and sequential arran- 
gement arc easier, and secondly, that there is no great difficulty in 
ciding what should be considered "focal” stimuli and irrelevant stimuli 
respectively. 
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(b) On the other hand, the not uncommon view that routine material 
with emphasis on pure drilling (unrelated facts: names, symbols) is 
particularly suitable for the current forms of programming, is based, 
partly at least, on a misunderstanding. Such material can of course 
be practised by the student himself, perhaps with the aid of a machine, 
but as a rule the effectiveness of the learning process cannot be increas- 
ed by the form of systematic constructional work usually associated 
with the term "programming”. The reasons for this are obvious: mate- 
rial that is not structured in itself docs not gain anything by structural 
analysis, and material to be learnt by heart in its entirety and as un- 
related items cannot usually be made more meaningful by focusing and 
weeding out irrelevant stimuli - all stimuli arc equally focal ! (For ex- 
periments connected with this argument, sec Shettel Lindley, 19^1; 
Hughes, 1962, p. 58.) 

(c) One factor that should be taken into account, on the other hand, 
is the degree of per manenc c of the subjec t-m atter. It should be borne 
in mind that conversion to effective self -ins true tional material requires 
so much labor that it is important not to expend this labor on a field in 
which today^s problems arc out of date tomorrow. 

(d) A more tactical point of view concerning subject-matter is that 
the beginner should not try to embrace connected work units that arc too 
large. It is important for him to arrive at a preliminary test relatively 
quickly. If the first attempt does not turn out well, not so much time has 
been wasted, and the constructor of the course can start revision work 
with equanimity and little loss of prestige. 

" Student points of view " 

(c) A not unimportant consideration in the choice of area is the esti- 
mated number of students who are going to use the material. If there 
is only a very small number, the amount of work required for the pro- 
gramming may perhaps be considered out of all proportion to the returns. 
(Cf. Kopstein & Cave, 1962. ) 

(f) If experience shows that sections of a course present the students 
with particular difficulties w hen conventional teaching methods are used, 
or when other types of course material available are totally inadequate 
or do not exist, then these sections would be natural starting areas for 
programming attempts, providing other circumstances arc not clearly 
contra -indicative. 
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(g) V/hcn it is difficult or expensive to bring together potential stu- 
dents scattered over a wide area for a centrally organized course under 
the direction of a number of experts, there is good reason to investigate 
the possibility of arranging tuition using s elf -ins tructional material on 
the local level thus avoiding travelling expenses, the costs of living 
away from home, etc. ), 

^ ’Inst ructors^ and constructo rs^ p oints of view" 

(h) Subject-matter for courses for which it is difficult to find a suffi- 
cient number of qualified teachers naturally suggests itself for program- 
ming. For this very reason considerable interest in programmed cours- 
es has been shown in countries in which the school system is undeveloped. 

(i) Subject-matter for courses for which it is difficult to find experts 
in a particular subject to act as constructors should, however, be left 
alone until experts can be found. Considering the total costs of the work 
on a course, amateurism in the subject-matter area should never be 
tolerated. 

It may be thought that most of the above points are rather obvious. 
Since labor and resources are very much tied down by large-scale con- 
structional projects of this type, the initial choice of subject-matter 
areas is by no means unimpoif’tant, howeve r. Nor is it particularly un- 
usual for constructional work to be started without careful consideration 
of the factors mentioned i:ere - motivated only by a causal interest. In 
order to prevent inadequately planned instructional projects of this kind 
giving poor initial results, there is every reason to consider these appa- 
rently commonplace arguments with a good deal of care. 
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5. GOAL ANALYSIS 

5. 1 GENERAL AIM; DECISION ON TERMINAL POINTS 

Once a particular area has been selected^ the next task is to analyze 
the teaching objectives. Analyzing the obiectives is, or should be, a 
vital stage in planning all instruction. The obligation to make such an 
analysis, however, i;i usually felt to be much stronger in constructing 
self -instructional material than in other contexts, particularly because 
of the importance generally attached to precision in supplying informa- 
tion, well -planned sequences and clearly registrable effectiveness (and 
of course, because of the absence of a teacher as a '^correction factor"). 
The "pedagogic conserves" - collections of facts that have been made 
more or less by chance and that have been retained because of routine 
or tradition rather than necessity - are numerous in most teaching 
areas and if goal analysis can break down the fences round some of 
these "conserves", it will be doing some good, quite apart from the re- 
sults bearing directly on specific self -instructional materials. 

The u.?e of systematic goal analyses in the field of education is no 
novelty. Nevertheless, goal -analytic arguments are undoubtedly acco:"^ 
ed greater importance in educational discussions and planning today 
than they were earlier. It is not unknown these days for a student to 
ask his academic teacher what the aim of the course being taught is; 
such stimulating direct questions were certainly not common before. 

But the fact that publishers, textbook writers, teacher trainers, edu- 
cation planners, etc. , speak more and more of objectives and goal ana- 
lysis does not mean that they particularly agree about what thesQ term^ 
imply. 

The terms obviously crop up in discussions with more persistence 
than accuracy. Those using then have sometimes proved to be compara- 
tively unaware of how a systematic goal analysis functions and, when 
given descriptions of typical procedures, they often feel rather doubt- 
ful as to its value. Increased precision is seen sometimes as a threat, 
sometimes as a triviality. At the same time there are fanatics who be- 
lieve that they could completely revolutionize teaching results simply 
by using goal -analytic techniq-"ie^ more systematically. This division 
of opinion calls for a closer examination of concepts and empirical stu- 
dies. 

Systematic goal analysis is a process v/ith several separate elements. 
The necessity of some of these elements may be debatable, but the 
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process has a very palpable product : a definite series of goal dcscrip - 
tions (for a given field). This product will normally have an important 
role to play in guiding the development of a complete instructional syst- 
em, as suggested above. 

5. 2 SOME POSSIBLE CRITERIA 

We all have ideas aboui; objectives in one form or another, and we have 
all been forced now axid then to formulate these ideas. Occasionally, 
the term "goal analysis" (or "analysis of objectives") is used to describe 
these comparatively unsystematic attempts simply to write down or in 
some other way make explicit our ideas about goals. It would be pre- 
ferable, however, to keep at least the term "systematic goal analysis" 
(and "systematic analysis of objectives"; we use these two expressions 
interchangeably in this context) for work which complies with certain 
standards. The question then is which criteria should be applied. 

There is almost no common practice here to fall back upon, nor any 
indisputable authority. If we try to summarize various lines of deveT-^** 
ment in current goal -analytic work, however (and primarily take up ge- 
neral criteria which can normally be applied in all fields), it should be 
possible to agree that at least the following criteria are reasonable 
starting points (cf. also the survey in Box 5. 1): 

(1) an empirical search for information as a basis for fixing objec- 
tives (it is not enough simply to try to formulate one^s own goal 
concepts ); 

(2) a comprehensive search for information (taking empirical data 
from a single source normaly involves a risk of bias); 

(3) collection of an empirical basis for giving priority to or evaluat - 
ing possible objectives; 

(4) firm rules for decision-making on the basis of the information 
gathered (a "firm d ccision- strategy "); 

(5) behavior-orientated precision in formulating goclls (an important 
phase later is formulating the objectives in unar .biguous , simple, 
communicable terms); 

(6) a supplementary logical check; 

(7) empirical goal checking (investigating how "realistic" goal speci- 
fications prove to be in concrete cases, assuming certain condi- 
tions with regard to resources and initial behavior); 

(8) post-checking revision of goals (successive revisions can be made 
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of goal formulations on the basis of the checking suggested in 
point 6), 22 
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Box 5. 1 What does a systematic goal -analysi s comprise? 



There is at present no generally accepted norm as to which crite- 
ria are necessary and sufficient for a systematic goal analysis; 
and even partial analyses are naturally often worthwhile. Some 
important components in a more complete process are, however, 
as follows: 

1. Search for goals 

. with empirical and 
. c omp rehen s ive methods, 

. providing a basis for priorities . 

Z. Focusing of goals 

. with firm rules for decision-making 
. beha~^rior --orientated precision in formulation, 

. and checKing that goal conflicts do not occur, 

3. Adjustment of gcals 

. with empirical goal checking : testing of '*goal -realism'*, 

. and goal revision : successive, post-checking revisions. 
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The order in which the ^‘criteria’’ have been placed here is at the same 
time a program, a sequence of work -phases within the framework of a 
complete goal analysis. 

Many more sub-criteria can easily be formulated, and it is also 
possible to summarize the eight points above under more comprehen- 
sive headings. A comprehensive three-phase division could be formulat- 
ed thus: (a) goal seeking (points 1-3), (b) goal focusing (points 4-6), 
and (c) goal adjustment (points 7-8). Phase 6-8 can also be excluded as 
a kind of supplementary work which is not always needed, and tnat 
leaves two main tasks: (I) to establish goals (points 1-4) and (II) to for- 
mulate goals (points 5-6). In the following sections some comments 
and examples will be given for some of the main points in the program 
outlinea here. 

5. 3 GOAL SEEKING, GOAL FOCUSING, GOAL ADJUSTMENT - SOME 
WORK-PHASES OF A GOAL ANALYTIC PROCESS 

5. 3. 1 Goal -Seeking: Empiricism and Comprehensiveness 

The main aim in the intr .)ductory, goal-seeking phase is to obtain as 
comprehensive a basis for decisions as possible. Some obvious quest-' 
ions to start with are: 

(1) How is a comprehensive basis for decisions concerning the X 
field of education to be obtained? What sources of information 
are to be consulted? 

(2) Are there at present any obvious discrepancies between the state- 
ment of objectives and the realization of those objectives? Are 
there discrepancies between the demands made on objectives to- 
day and the demands that v.dll be made in the foreseeable future? 

Box 5. 2 shows different ways in which these questions can be approach- 
ed. The left-hand columns gives examples of a number of possible sourc- 
es of information, divided into the main categories: texts, "practitio- 
ners**, contact groups, teachers, students, and other members of socie- 
ty in general. The plus signs in the other three columns are intexided to 
mark some of the cases where a survey of the particular subject-area 
suggests that information is primarily needed. The signs in the table are 
naturally only examples, although they have been chosen with a view to 
presenting a reasonable pattern. (The plus signs in brackets mark se- 
condary sources; and the unmarked sections those which are not relevant 
here. ) In the following we will refer to concrete examples - mostly from 
current Swedish work - of the various types of analysis, 
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Box 5^ 'l Goal - seeking: Examples of possible sources of information 
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See text for more detailed discussion and explanations. Points 2-3 are 
of particular importance in the case of focused job -training, but less re- 
levant in general education, e, g, in the comprehensive school. 
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Text analyses often make good starting-points, and in many cases 
the official documents arc worth a closer study^ An example of this 
tyj:)e of text analysis (focusing on the demands made by society on gra- 
duate teachers) can be found in L.bfqvist ( 1969 ). - The official texts pri- 
marily describe the “desired present situation"; what it cannot give 
any information on is the actual present situation (which can after all 
sometimes differ considerably frorri the planned ideal). Moreoever, 
official plans arc sometimes formulated in extremely vague and gene- 
ral terms. So additional, more precise information is often needed. A 
selection of the most frequently used textbooks can in many cases give 
more substance to the general outlines. They provide a picture which 
is often closer to the actual present-day situation. An example of text- 
book analysis can be found in Lindcll ( 1969 ; focusing on the teaching of 
the German language to Swedish beginners). At the same time, it should 
not be forgotten that much of the content of the textbooks is there by 
tradition rather than as a result of planned analyses (Tingsten^s stimu- 
lating analyses of textbooks in history and geography show how old tra- 
ditions often cling with remarkable tenacity in school books that are fre- 
quently reprinted; Tingsten, 1969 ) and that those writing the textbooks 
have not always fulfilled the aims set out in the curriculum. So a text- 
book analysis can usually only b yet another small part of the goal- 
analytic whole. In some fields, documents stating international policy 
have been issued and may help to clarify the desired trends of develop- 
ment. 

One central source of information is those people who can be group- 
ed together under the general heading " practitioners" : those who, to a 
large extent, practise skills and apply knowledge within the subject area 
with which the analysis is dealing. V/hen training for a particular job is 
being studied, then naturally the job in question is the main object of in- 
terest; in many other cases the group is not so clearly defined. Several 
different methods of collecting data arc possible: spot questioning (by 
interview or questionnaire), personal reporting for a specified period 
("diary method"), or direct and detailed observations of behavior. Some 
of the main questions arising arc: V/hich skills in the field seem the 
most essential for an adequate total pattern of behavior and for an indi- 
vidual feeling of fulfilling a function well, and on what points do the 
"practitioners" feel their basic training to be inadequate? In many cases 
interesting material is revealed by questioning the persons closest to 
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the "practitioners” (" contact /;;roups ^*). This applies particularly in 
studies of job -training for professions specifically involving contact 
with others. Studies of "practitioners" and "contact groups" arc central 
to what is known as the B Project m our department, a project based 
on job -analyses of school -administrator s , lecturers in teaching method 
and tutors (sec c. g. Gestrelius, 1970). 

Both teachers and students -- those directly involved in teaching -- 
arc natural sources of information in many goal -analytic contexts. What 
in fact arc the central ideas on objectives in the teaching world today 
and what changes seem most urgent? There are two ways in which teach- 
ers and student! can be studied: cither by picking random samples of 
individuals (perhaps primarily in order to get a cross-section picture 
of the actual situation, such as it is experiences by representatives of 
both categories), or by specially choosing groups of people with a par- 
ticular interest in the subject-area (and then perhaps primarily in or- 
der to obtain a broad outline of the changes needed). A study of student^s 
preferences in the choice of material is reported, for example, in Lrind - 
sten (1969). This aspect can be named " student-centered need analysis. " 
Swedish commissions on schools have sometimes made use of this type 
of need analysis (sec Harnqvist Grahm, 1963). 

Representatives of society outside the circle of "practitioners" and 
outside the school world should also frequently be given a chance to make 
themselves heard -- especially when we deal with final objectives. Ran- 
dom samples can perhaps also be used for this occasionally, but it is 
more usual to approach special "consumer" groups (the prospective 
employers or the institutes for further studies). " Consumer analyses " 
have actually played a not unimportant part in the work of Swedish com- 
missions on schools; Urban Dalillof's work on "Gymnasium" education 
is an obvious example (see Dahllof, 1965; cf. also Husen & Dahllof, i960). 
A similar approach is often needed in projects on the development 
of material (see e. g. a study of foreign language requirements in sec- 
tions of the Swedish business world in Larsson, 1969). This aspect -- 
in contrast to the student-centered need analysis mentioned above -- 
can be called "society-orientated requirement analysis" . In addition, it 
is often valuable for those constructing material to be confronted with 
some kind of " expert group " at an early stage. These people may be 
experts in the subject (perhaps in the front-line of research with quite 
different ideas about what is and is not important than those suggested 
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by conventional textbooks). But they could also be ejtperts in method: 
people who have been particularly intens '■ely engaged in teaching and 
in teaching innovations in the field in question. Goal -analytic work, 
based on "expert*' opinions, was included in planning the broad outlines 
of the IMU system, a Swedish methods - and - materials system for in- 
dividualized mathematics instruction (see Oreberg, 1966)* When the 
main i->urpose is to gather ideas and suggestions frona a grovp with a 
special interest, a suitable starting -point can be a conference with small 
group discussions, which differ-ent points of view are confronted, result- 
ing possibly in a closer definition of concepts and a decision on priori- 
ties for partial objectives. - When it comes to future developments, 
information can sometimes be sougl/* from variouscategories of people 
specially detailed to plan for the future, simply called "planners*' in 
Box 5. 2. Unfortunately, there are all too few persons of this type in the 
world of education today. 

The catalogue of possible sources of information perhaps gives the 
overwhelming impression of this being an extremely long-term process. 

It should be understood, however, that these sources are hardly ever 
all used at the same time. In each separate case a decision has to be 
made as to which sourcc;s arc the most important in view of the reso’ r- 
ces available and the problems to be studied. Often, however, it turns 
out to be more advisable to explore more than one source less intensive- 
ly than the concentrate everything on a single aspect: it is easy to be- 
come biased if restricted to one single source of information. Some of 
the criticism directed at e. g. consumer analyses docs not claim prima- 
rily that such analyses arc unjustified, but rather that they are utilized 
too directly in the planning process v/ithout sufficient balance being main- 
tained between different points of view. Similar criticism has often been 
made of those work analyses which only study the actual present-day si- 
tuation; it is claimed quite rightly that additional information must be 
sought, on which desirable future models and objectives can be based. 

Let us summarize some of the points covered above, tying them down 
more specifically to the self -instructional situation. We may then note 
that existing "source material" in the form of current syllabuses and 
text-books (so often used as the sole source of inspiration in program- 
ming) is valuable for analyzing objects, but -- and this is what we want 
to stress -- that the usefulness of such material should not be overrated 
If we rely too much on these sources, we may not make full use of our 
opportunities to increase efficiency. The shortcomings of these sources 
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stem chiefly from two characteristics- Firstly, syllabuses and similar 
directions about instruction are often extremely vague and generalized 
in their formulation. Secondly, existing course material in the form 
of handbooks and textbooks not infrequently contains subject-matter 
that is quite extraneous to the objectives in question, being the result 
of chance, tradition, or personal interests of the author rather than of 
planned analysis. 

In determining the necessary actions and knowledge (’ ^terminal be - 
havior'* and ’ ^terminal knowledge* ’) then, some of the better starting- 
points are: (a) an exact, detailed description by one or several experts 
in the subject , perhaps supplemented by a more extensive opinion poll , 
i. e. a study of so-called "consumer demands"; (b) a systematic obser - 
vation of typical behavior in employees who are recognized as being 
good at the particular job that the course is designed to train people 
for. On which of these two approaches the main emphasis will fall, de- 
pends partly on the relation between manual -prac tical and verbal -theo- 
retical aspects in the final result aimed at. As a rule, the more verbr.l 
theoretical factors there are (in a number of typical school courses 
these predominate), the greater the part played by descriptions by ex- 
perts in the subject. The more manual -practical factors there are (and 
these would be frequent in many industrial courses), the better the in- 
formation derived from observation Systematic observations will often 
give a clearer picture of the frequency of various behavioral acts than 
an individual expert^'s statements. . 

In choosing experts in a subject/ it should be remembered that the 
constructor appointed probably often has sufficient qualifications to 
make an expert description. He was presumably chosen for his compe- 
tence in that subj ect. But it is quite possible and often desirable that 
for this particular part of the work an even more highly qualified person, 
a top-ranking expert in the field, should be consulted. This applies 
especially to fields in which there has been rapid development in recent 
decades. In that case it may be only the outstanding scholar or scientist 
who has sufficiently good qualifications to state what is really fundamen- 
tal at the time, without having to fall back on traditional material It has 
been reported that some of the physics books used in schools, for in- 
stance, still rely on nineteenth century physic s at some points. Physics 
programming then should begin with an attempt to formulate what is es- 
sential and lasting, and this task should preferably be carried out by 
some one who is himself actively engaged in front-line research. 
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The expert in a subject, however, needs a certain amount of instruc- 
tion in how to formulate his survey in such a way as to provide a prac- 
tical basis for further work. Such instructions would usually be drawn 
up by a programming specialist in collaboration with the organization's 
own expert in the subject, 

5. 3, 2 Forming a Basis for Priorities and Making Decisions 

After the completion of as detailed and comprehensive a search for in- 
formation as the particular purpose and the existing resources permit, 
the question still rcm.ains of how decisions are to be made on the basis 
of the information now available. It is quite conceivable that the total 
picture given by the information will show a considerable degree of con- 
flict between the different sources (in the discussion of goals for univer- 
sities, for example, the opinions of ^^consumers" and research workers 
often differ), or that the objectives outlined in official quarters are 
strongly at variance with what powerful tides of public opinion or objec- 
tive observations deem reasonable. If this type of picture should emerge, 
it should not be the duty of the research worker to make the decisions or 
try to conjure away the difficulties; instead he should pass the informa- 
tion to the official decision makers most closely concerned, who will 
thus be given a more satisfactory basis - with all the facts on the table - 
for future action. It should be added, however, that such contradictory 
and unwieldy material is not often obtained. More usually, the various 
sources of information complement one another, and no real conflict 
arises between official objectives and the rest of the sources; instead 
the latter make possible concretion and specifi ation of the comparative- 
ly vague and general terms of the official source. In such cases the 
collection of material has provided a considerably improved foundation 
for the work remaining to be done. 

It is difficult to state general rules for the measures needed for form- 
ing a basis for priorities and making decisions, since in the actual tran- 
sition from the collection of material to the making of decisions the mea- 
sures vary considerably depening on the type of objective (partial or fi- 
nal) and the type of education concerned. In any case, it is important to 
decide on firm strategies* Up to now, however, relatively little systema- 
tic work has been done here -- within the no many's land between research- 
workers and politicians. 

Normally it can be an advantage to keep the two phases clearly sepa- 
rate. Before deciding on priorities the research-worker or the worker in 
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educational developnnent must first gather information; this can be 
seen as a sub-task under the heading "goal seeking”. In some cases 
the decision-making can be a fairly simple procedure with in no way 



area the general outline of wh^ch has 'Already been decided, or when the 
available material is clear-cut); in other cases, on the other hand, it 
can have considerable political consequences and as a result involve 
quite different categories of persons. This decision stage is a sub- 
phase under the heading ”goal focusing”. 

Sometimes the information needed on priorities emerges more or 
less automatically at an early stage. But it is often an advantage to col- 
lect as much comprehensive information as possible first, and then 
find out how it is evaluated or ranked by various interested groups- The 
main advantage here is that the evaluation or ranking can be carried 
out more comprehensively, once a primary basi.^ has been obtained. 

This can mean that some of the groups named in Box 5. 2 are contacted 
twice: first to get spontaneous information on objectives, secondly to 
get from different points of view evaluations of (rankings of) lists of 
partial objectives, compiled on the basis of the first collection of data. 

It is perhaps rather unusual to incorporate an "evaluation phase” 
separated in time from the primary search for information in this way. 
Concrete examples and more detailed arguments can be studied, hov/ 
ever, within the framework, for example, of Project B, mentioned 
earlier (see Gestrelius, 1970). 

5. 3. 3 Formulating Objectives 

When it comes to formulating objectives, it has proved advantageous 
(a) to express the objectives in terms of behavior, and (b) to try to 
combine the formulation of objectives with the working out of "terminal 
tests” (final tests which contain tasks corresponding to all points stated 
in the objectives. 

Many educational technologists now agree that an effective state- 
ment of objectives has the following qualities: 

(a) It does not confuse description of courses (process description) 
with description of objectives (product description ). A programmer with 
little experience is sometimes inclined to confuse the description of 
terminal objectives with the description of what happens while the course 
is in progress. This confusion may arise from the ove roptimistic ten- 
dency to obscure the distinction between what the teacher goes through 



farreaching consequences (e. g. in the case of sub-sections of a course 
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in class and what the student actually learns. Obviously, however, 
there may often be a considerable difference between what is ’’taught*’ 

(if by this is meant what is presented during a course) and what is 
’’learnt” (if by this we mean demonstrable additions to or changes in 
the student^s behavioral repertoire). 

It is a somewhat trivial, but important fact that ’’initial behavior", 
"course process", and "terminal behavior" are three separate pheno- 
mena (distinct both logically and in time). Sometimes it is necessary 
to formulate "starting requirements". In that case we describe what 
the student must know before taking a certain course. In other situa- 
tions there are grounds for formulating a "description of the course" 

(as often happens in a syllabus or a prospectus). But when, in planning 
self -instructional material, we have to draw up a "terminal descrip- 
tion" we arc attempting something quite different. Then we have to 
state what a student is able to do after he has completed the cour*"e (if 
the course functions the way we want it to). 

To take an obvious example: The statement "The principles of pro- 
grammed instruction arc discussed on the basis of an historical survey 
and a detailed account of Skinner^s theory" presents us with a "course 
description" ("process description"). A "terminal description" ("pro- 
duct description"), on the other hand, might look like this: "Should be 
able to describe at least three basic principles of programmed instruc- 
tion and state at least two essential features of Skinner^ s theory corre^ 
ly". 

(b) The description of objectives concerns, to the greatest degree 
possible, observable (and thus clearly communicable and verifiable) 
conditions. It thus avoids terms which can be given varying interpreta- 
tions by different readers. It is not enough, for example, to say that 
a student should know a law of physcis A, or that the should understand 
a mathematical argument B. We must try to explain how the student is 
to demonstrate that he "knows" A or "understands" B. 

Many words commonly found in syllabuses are difficult to interpret 
unambiguously. Among the terms which occur very frequently, but which 
are somewhat ambi^^uous in the description of a course are words such 
as "understand"^ "know about", "appreciate". It is obviously not wrong 
to say that the student should "understand" a certain situation, but it is 
often not specific enough to provide a good starting point for preparing 
material. Unless we indicate some explicitly observable signs of com- 
prehension, it is difficult for us to agree whether a student has attained 
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the desired objective. Examples of words which have a more unambig- 
uous meaning than those cited above are: ''construct”, "enumerate”, 
"give examples of", "identify”, "reproduce", "write down" etc. As 
a rule, then, such words referring to observable behavior, arc pre- 
ferred in our terminal descriptions. 

Let us look at the following descriptions: (a) "The student should be 
able to appreciate fully Swedish poetry of the ^fortics^. " (b) "The stu- 
dent should have gained a complete understanding of the causes of the 
Cuban Revolution. ” Do these two statements satisfy the requirement of 
"communicability" set up above" Obviously not. None of them identi- 
fies clearly observable behavior. Strengtlxening additions (such as "app- 
reciate fully ,", " complete understanding") usually do not make it easier 
to give such statements an unambiguous interpretation. 

(c) The description of objectives also states the prerequi sites, which 
define more closely the demands made on the student^^s behavior. W e 
do not simply say, for example, that the student should be able to type 
out a F rcnch business letter. Wc must also state if he is to be able to 
do it loth from oral dictation and from a handwritten manuscript (type 
of stimulus), if he is to be able to do it both on an ordinary office type- 
writer and on an electric typewriter (type of tool), if he is to be able 
to do it with or without the help of dictionary (type of aid permitted) 
etc. (Among other things, a clear definition of the stimulus situation is 
important in order to prevent what unfortunately often happens: that we 
unconsciously lower our standards and make do with indirect stimula- 
tion of the type verbal answer to verbal stimulus instead of a more di- 
rect response in a complicated concrete problem situation.) 

We distinguished above between a volume of knowledge which is ac- 
tivated "spontaneously" (that is with minimal cues) and a volume of 
knowledge which is only activated when a choice of specific alternatives 
is to be made. A given series of alternative answers is an example of o 
one kind of situational prerequisites and such prerequisites - if they 
are acceptable to our purpose in the course - should be stated in the 
description of objectives since their acceptance in fact makes the objec- 
tive different. The behavioral requirement can usually be made quite 
clear by using such phrases as "Without a dictionary the pupil should be 
able to ... ” ("aids"); "Using log. tables the pupil should be able to . . . "; 
"If the pupil is presented with a list of ... , he should be able to identi- 
fy. " ("alternative choices given"), etc. 
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One method of checking to see whether the situational prerequisites 
have been made specific enough is to let someone go through a collec- 
tion of test items in the subject-matter area and sort them into two 
piles: those covered by the given description of objectives (’'the plus 
category”) and those not covered (”the minus category”). If there are 
too many test items in the first category, more than the programmer 
intended, orif there is considerable hesitation in making this classifi- 
cation, then the description of objectives must be made more specific 
(i. e. , more restrictions must be introduced). If there are too many 
test items in "the minus category” (more than the programmer intend- 
ed), then the description of objectives must be made less specific (the 
number of aids allowed must be increased, etc. ). 

If such a check is to work satisfactorily, we must assume that the 
programmer himself knows precisely what the goal is. In other words, 
in this case the check docs not apply to the suitability of the goal, but 
only tests how well the programmer has succeeded in making his goal 
clear to others in his terminal description. If the check works out well, 
we may say that we have adequately described the conditions necessary 
for excluding ir'^elevant student behavior (behavior that cannot be taken 
as evidence of the goal having been attained). Nor have we excluded too 
much. 

(d) ^ soon as we arc dealing with a continuum of possible achieve- 
ments in the relevant behavioral field, the description of objectives 
should give a "pass criterion”, or liminal value, i, c. the lower thresh- 
old value which the student ought to attain. What is meant, for example, 
by typing out an English business letter? What demands do we make 

on speed? How many errors are we prepared to tolerate? (This demand 
for a clear statement of limdnal values constrasts strongly with the 
numerous expressions to be found in traditional curricula, such as 
"some knowledge of . . . ”, "deeper knowledge of . . . ”. ) 

Such as threshold value or "minimum for success" can be expressed 
in many different ways. Tow of the most common are to state a time- 
limit or the error tolerance. The error tolerance in turn may be ex- 
pressed either as an acceptable deviation from a certain standard ("ne- 
gative formulation") or as the smallest percentage of a given series of 
problems which the student should be able to solve ("positive formula- 
tion”). 

(e) Finally, the descri ption of obje ct ives is inclusive; it must not ex- 
clude any part of the total goal area, even if one particular part should 
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prove more difficult to formulate in terms of specific behavior. Non- 
cognitive (e, g. attitudinal) objectives can sometimes be difficult to 
describe precisely, this fact must not be used as an excuse for not 
including them in the goal -analytic phase. 

If another person conversant with the subject can. after reading the 
description of objectives and t^eeing the test results of a number of 
students, state which of these students have succeeded in attaining the 
objective and which have not, and if this person s classification of the 
students agrees with that of the person who drew up the description, 
then the description has been successful in communicating the objec- 
tives unambiguously, and the main purpose has been achieved. If this 
is not so. then communication has broken down. The various features 
of a good description referred to above are neither absolutely essen- 
tial in themselves, nor necessarily entirely adequate. However, ex- 
perience has shown them to be useful aids for increasing communica- 
bility. It might therefore save time and trouble to bear them in mind. 

5. 3. 4 Logical Goal Analysis and Other A Priori Checks 

As one sub-phase within the process of ’’goal focusing", wc might wish 
to include a "logical goal analysis" for the purpose of studying the fi- 
nal formulations of the various goal components in relation to each 
other. Difficulties can arise, for example, if some objectives conflict 
with others. In juch cases of conflict, the person responsible for ana- 
lyzing the objectives usually has to refer the question back to the de- 
cisionmaking level for a new decision on priorities. A preliminary lo- 
gical analysis is naturally made during the goal-seeking stage, e. g. in 
the text analyses, but the final logical check should be made at the same 
time as the descriptions of objectives are given their final form. - 
Other a priori checks can also be made, e. g. expert opinions on how 
realistic the descriptions of objectives are in the light of earlier ex- 
perience of the target-groups in question. 

5. 3. 5 Adjustment of Objectives; A Posteriori Checks and Revision 

In one sense the goal -analytical work is complete once the final version 
of the objectives has been precisely defined and operationalized in the 
form of a terminal test. After that it is up to the teachers (or the con- 
structors of instructional materials) to attain the objectives. If the first 
attempts achieve little success, it is usually not the objectives that 
need revising, but the methods or time schedule. Normally a teaching 
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system cannot be considered ready until the given objective has been 
reached. 

The chances of carrying out this ideal strategy, however, depend 
largely on resources: time for teaching and time for systematic im- 
provement of methods. There is a strong possibility that in some cases 
(and despite what is above called a priori checks) we have aimed un- 
realistically high and that a revision of the levels of the ol^jectives is 
well -motivated. Resources can also change in a way not predictable at 
the start, s*uch as when the time alloted to a course is reduced. (Even 
though one in principle does not want to accept the present all too domi- 
nant role played by time schedules, there are naturally often sound rea- 
sons for this kind of limitation of resources. ) 

The normal techniques for checking the quality of methods and mate- 
rial in a new teaching system can in some situations also be used to 
check how realistic the objectives are, allowing for a certain initial le- 
vel in the target -group and certain resources. If empirical tests of 
this kind suggest that the level of the objectives is unrealistic, then it 
may be necessary to revise the objectives and undertake new tests. 

It would take too long to discuss this supplementary woxk in detail; 
what has been said above must suffice vo make it clear that work on 
goal analysis can also involve p gradual adjustment of objectives, mak- 
ing use of empirical feed-back. 

5.4 A FEW QUERIES 

It is obvious that often when people say that they are carrying out goal 
analyses, they are in fact only working with a relatively small part of 
the spectrum of tasks outlined here. The reasons for this are some- 
times sound; on other occasions they simply seem to be unaware of the 
opportunities available. 

Among the influences which have served to bring goal -analytical 
work much more noticeably to the fore in general educational discus- 
sions, is the interest in programmed instruction and in systems of edu- 
cational technology (sec e. g. a ‘'classic" like Magcr, 1961, or discus- 
sion reports like Popham et al. , 1969). But the point that is most heavi- 
ly stressed in these contexts is often the precise formulation of objec- 
tives. It seems very reasonable (and there have been experiments on 
this, too) that the process of instruction can be speeded up if teacher 
and students have a clearer idea tlian is usually the case of where they 
arc going; irrelevant behavior then tends to diminish and the student 
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trains more intensively what is later going to be tested. On the whole, 
this emphasis on the value of formulated objectives as an instrument of 
guidance and focusing has had a very beneficial influence on both the ge- 
neral discussion of objectives and the work being done on systems of 
material and methods. Nevertheless, it is surprising how indifferent 
some of those urging the need for precision can sometimes be to the 
relevance and significance of the given objectives seen from other points 
of view. In such cases our criterion 5 (the formulation of objectives) 
has been allowed to weigh so heavily that there is a risk of other points 
of view (the seeking of goals and decisions on goals) being neglected on ~ 
tirely. This state of affairs has led to some rather strange contribu- 
tions to educational discussions, which sometimes give the impression 
that one is forced to choose between precise trivialities or diffuse but 
significant objectives. If it could be made clear that the setting up of 
objectives and the formulation of objectives are two stages -- both very 
important --in one and the same goal analysis, then the debate would 
become less muddled. 

There are other examples of an unhealthy bias. The demand for em- 
pirical foundations has among other things resulted in extensive and 
extremely useful consumer analyses being made. These analyses have 
sometimes, as was hinted above, aroused criticism. This criticism 
has occasionally been expressed in political slogans (''we shall not lot 
education be manipulated by the business world and high finance"), 
but has all the same contained an important core of insight, namely 
that objectives should not be set up on a one-sided empirical basis. 
Short-term utilitarian perspective s (dredged from consumer analyses) 
should naturally not dominate educational planning to such an extent 
that we deprive ourselves of the chance of developing completely new 
ways of achieving such a reconstruction of society which we agree to 
be desirable. Fundamental values must in some way be inserted in the 
equation, so that we are not tempted to equate consumer analyses with 
educational planning. The work carried out on consumer analyses has 
been very important, to some extent pioneering, but those interpreting 
it have perhaps on occasions been over-eager in generalizing the results. 
They then strongly emphasize our criterion 1 and at the same time tend 
to forget criterion 2, which balances it, aud are not always particularly 
interested in the other criteria. 

Considering these various tendencies towards what has here been 
called one-sidedness, the following question seems self-evident: If we 
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accept the criteria given above as a description of a complete, syste- 
matic goal analysis, to what extent does this paragon actually exist in 
our hurried and stressed environment? This question would be worth 
studying more closely, but at the present time the answer would pro- 
bably be that such complete analyses are at least not common. And 
what then is the reason for this? One important factor is naturall'' 
that the technique is not widely known. But can there be other reasons? 

Is their value perhaps doubted when considering the amount of work in- 
volved ? 

In fact, this field, which has attracted increasing interest and ac- 
tivity, contains a whole series of subjects suitable for re«;earch and 
developmental work. It would be of interest, for example, to set up a 
series of alternative models for goal -analytic processes and for state- 
ments of objectives. Many questions then follow naturally; How common 
are the various models and the various types of goal descriptions in 
different educational developmental contexts? What goal concepts and 
goal descriptions exist at present in the sphere of practical education 
(among those working on curricula writing textbooks and training teach- 
ers, among administrators, teachers and students)? In what ways do 
these goal concepts and goal descriptions differ from the norms most 
commonly recommended by experts on goal analyses? Which advantag- 
es or disadvantages do various categories see in the more exact me- 
thods? Which arguments occur most commonly against the use of in- 
creased precision? And to what extent can one show, by means of ex- 
periments, clear-cut effects of strict goal analyses in various practi- 
cal situations? 

This problem area of goal analyses, so hasti'^y touched upon here, 
is of central importance and can hc*ve practical consequences for seve- 
ral aspects of educational planning. There is good reason, therefore, 
for making it the object of further conceptual analyses and discussion 
and increased empirical investigation. 

5. 5 SPECIAL AIDS: TERMINAL, CHARTS, TERMINAL CARDS, AND 
TERMINAL TESTS 

It is often helpful to describe '’terminal requirements" in the form of a 
"terminal chart" (or a scries of "terminal cards") and a representative 
"terminal test" based on these. 

A " terminal chart " is simply a system of square# in which the ho- 
rizontal rows represent the desired objectives and the columns give the 
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spejial conditions in which the student should be able to give evidence 
of the behavior in question, e, g, (a) the reference works or aids with 
which the student should be able to solve the problem and (b) the degree 
of proficiency with which he should be able to do it. 

The appearance of the chart will vary considerably depending on the 
particular subject-matter dealt with, but some of its major aspects are 
illustrated in Figure 5. 1, 

A few examples. If t!ie terminal behavior is the ability to work out a 
correlation coefficient of a certain type, the question of *’aids permitt- 
ed'^ is important when presenting the course material. Under some cir- 
cumstances (if it is a question of fairly advanced statistical work) we 
may require the ability to make these calculations without apy aids at 
all. In that case we put *'0*' in column A in the table and then we must 
make sure that the study material gives the student the kind of training 
that will enable him to work out these coefficients independently and 
confidently without using formulae or models. In other cases perhaps 
we only require the calculations to be made with the aid of formula. In 
still other cases, when a job requires less independent calculations, 
we do not even ask this much, but only that the student has a certain 
amount of practice in following a step-by-step model. This model then 
comes under the heading of ''aids permitted". 

In many tests of proficiency, the speed of working ( column B ) is 
very important. We do not convey much information if we state only that 
a pupil should be "able to transmit a Morse telegram" or be "able to re- 
ceive a Morse telegram". An indication of the minimum requirements 
for the transmission speed and the receiving speed (e. g, , the number 
of signs per minute) would be much more to the point. 

The error tolerance to be allowed ( column C) must often be consider- 
ed together with the requirement of speed. In several cases, absolute 
perfection is so essential that the error tolerance must be considered 0. 
This applies, for instance, to certain instrument readings in flying an 
aeroplane, where even slight mistakes can endanger life. In other cases, 
of course, we can be a little more tolerant, c. g, slight spelling mistakes 
in typing a running text. 

As the number of terminal objectives is often large, and as it may 
be useful for further work to have descriptions of these terminal objec- 
tives in a form that readily allows rearrangements, additions etc, , it 
is often convenient to work with " terminal cards ", at least initially, in- 
Q stead of a fixed "terminal chart". Each card then corresponds to a 
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horizontal segment in the "terminal chart". The card should thus in- 
clude the same data as is contained in one row of squares even though 
the information need not necessarily be presented in the same format 
(column distribution). 

To obtain further guidance for the construction of the study material 
and to get clear-cut instruments for estimating the effectiveness of the 
material from the very start, it is \iseful, even at this stage, to draw 
up a representative "terminal test", i, e, a series of tasks containing 
sample tests of the proficiency and knowledge which the student is ex- 
pected to have acquired in the terminal situation. The "terminal chart" 
and the "terminal cards" provide the basis for the construction of the 
test. All the essential part objectives will normally be represented in 
the test; the conditions given (including aids), the requirements of 
speed, and the error tolerance should be taken into account. 
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6. STUDENT ANALYSIS AND SITUATION ANALYSIS 



6. 1 STUDENT ANALYSIS 



The basic analysis of prerequisites also includes a student analysis, i. e. 
a survey of the special characteristics of the intended target population. 
We have particular reason to study the students^ ' initial repertoire " 

(the behavioral repertoire they take to the study situation: previous 
knowledge and existing skills etc. ) and their probable '^ medial situation ** 
(the experiences that await them and the opportunities for training which 
arc available between the study situation and the terminal situation pro- 
per. 




6. 1. 1 Expanded Terminal Chart 

The result of the student analysis should prefer .bly be incorporated into 
an ** expzindcd terminal chart The data on the target population are in- 
troduced as extra *'spccificators which provide further information 
on the prerequisites for the training course. As shown in Figure 6. 1, 
these data can, for example, be placed in a Column D (‘‘initial pre- 
requisites'*) and a Column E ("medial influence"). 

The initial prerequisites we arc thinking of here arc primarily pre- 
vious knowledge and already existing skills (certain other prerequisites 
will be mentioned further on). When the entire target r Dulation has 
certain pre-knowledge , significant cuts can naturally ^ made in the 
study material. This often happens in courses for ad , which recruit 
people with basic vocational training. When a large pr.rt but not the en- 
tire target population is thought to have previous knowledge, a special 
"supplementary course" is needed for hesc who have no previous Icnow- 
Icdge and in addition a "filter test" to extract this group, in the casef^. 
when it is not obvious in advance. 

Column D ("initial prerequisites") is thus concerned with the past. 

An assessment should be made for each separate desired terminal be- 
havior, stating to what extent it may already exist as initial behavior 
for the target population as a whole or in part. 

Column E ("medial influence") attempts instead to take a look at the 
future* In some cases the individual's ordinary occupation ( which he 
practises between the study occasion and the terminal situation) makes 
it easier for him to retain the knowledge acquired. In other cases, how- 
ever, it can make it more difficult for him ("interference"). A probability 
assessment of this is made in Column E. . To what extent does "medial 
behavior" (the existent behavior between the study situation and the 
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Figure 6. 1 Expanded terminal chart 
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terminal situation) reinforce the desired terminal reactions? To what 
extent does it interfere with the retention of skillfi? Any attempt to 
make such an assessment on the basis of acquaintance with the target 
population can often of necessity !iC no more than approximate. 

Let us suppose that we are dealing with behavior for which the termina 
situation is mobilisation and the study situation a military courCe. If the 
particular target populatio: consists of people who can in their normal 
occupations maintain the acquired skills, then we can say that the me- 
dial behavior forms a supporting connecting link between study behavior 
and terminal behavior (and we might signify this with for "strongly 

supporting" and for "rather strongly supporting" when it comes to 
individual skills). In many cases the medial behavior is neither support- 
ing or interfering. V/e then put "0" in Column E and perhaps count on 
the acquired knowledge and skills gradually diminishing as time passes. 

Finally, in other cases we must take interference into account. It 
can be a question of individual slcLlls: e. g. if two different methods of 
notation are used in civilian and military practice, or if the students 
use two different shorthand systems (one in the study and terminal situa- 
tions and another in the medial situations). But it can also in /olve more 
general behavioral roles connected with a certain position in society. 

A man who in his everyday life is used to leading others and acting in- 
dependently naturally often finds it more difficult than someone who has 
a more subordinate civilian position to enter into the role of the sub- 
missive and obedient private soldier, which he practised for a few 
months in his youth and which he is expected to resume in the event of 
mobilisation. -- The idea of having the right man in the right place in 
a mobilisation context means - - using our present terms -- making 
sure that the "terminal role" and the "medial role" are mutually "con- 
sonant", so that the medial behavior becomes a reinforcing factor 
rather than an interfering one. In many cases, however, general role 
dissonance or special behavior dissonance must be accepted as unavoid- 
able and this should then be marked in Column E (e. g. with one or two 
minus signs to denote a lesser or greater degree of interference), and 
then measures must also be taken in the training situation to make the 
effect of the training maximally resistant to interference. 

The interference phenomenon can sometimes occur s imult an e ou s ly 
as an "initial prerequisite" and as a "medial influence" and thereby have 
an increased effect. This land of dual- effect often has to be taken into 
account, for example, in the teaching of foreign languages. An Engl?^^ 
student comes to the course in French or German with deep-rooted 
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English language habits, including patterns for the combination of 
language categories, a set of well-trained sounds and special intonation 
series. Some of these combination patterns, sound and intonation se- 
quences are parallel in the student mother -tongue and in the new 
language. These cause relatively little difficulty. In other cases, how- 
ever, there is a lack of agreement and this is where the established 
language habits make learning more difficult. This interference con- 
tinues both during and after the course, since training in the mother - 
tongue goes on all the time. 

Opinions are divided on the best way to counteract the effect of the 
interference factors. No-one can deny, however, that they do exist and 
that they exert a strong influence. This is shown most clearly in the 
fact that school children from different countries make very different 
mistakes when learning a p.v^ticular foreign language. This should in its 
turn mean that when training any one language, the main emphasis 
should be placed on different points for different groups of students 
(representing different language areas or sometimes even different 
dialectal regions). 

Linguistic interferences should, therefore, be considered a matter 
of central importance when self -instructing aids arc being constructed. 
For that reason it is often advisable, when working out courses in 
foreign languages to use a slightly diffcr( t form of expanded termina l 
table, where the interference phenomen is given a •' '‘V . o column . It 

is naturally p ossible to learn languages with th^- •''^Ip of courses which 
have not been adapted on the basis C7." .i.ng iix crfcrcnccs. The courses 
which arc often arranged in a country for mixed group.s of foreigners 
prove this, as do the cases when a course originally intended for use 
in another country has been ‘‘borrowed**. There is reason to believe, 
however, tliat this often leads to a considerable loss of efficiency. Some 
students arc given unnecessarily long training on points which cau‘ c 
them no difficulty, while others get far too little practice on the items 
which arc the most problematic for them. (For further reading in this 
particular field, sec a bibliography with the title, “Contrastive studies 
in linguistics*'. Gage, 1961; sec also Lindcll, 1969. ) 

6, 1 , 2 “ Modified Terminal Test* * 

The expanded terminal tabic should also lead to certain modifications 
being made in the terminal test. The types of behavior that can with 
tainty be said to exist as initial behavior in the student group in question 
naturally need not be tested, but can be omitted from the test. This 
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rricans that the data in Col. D must be taken into consideration. Further- 
more, we must often try to estimate the immediate effect of a particular 
study material, even when the tc-r.minal situation is remote in time. In 
that case v/e must also, when constructing the test, heed the circum- 
stances stated in Column E, together with the interval of time which is 
relevant in this context. Thus the immediate test becomes a ** ps eudo- 
terminal and it is often reasonable to make these immediate demands 
somewhat higher than the terminal table otherwise declares to be ne- 
cessary. 

Some readers perhaps think that this two- stage procedure ( first 
establishing a terminal table in purely general terms and a subsequent 
terminal test and then a terminal table extended on the basis of student 
analysis and a subsequently modified terminal test) is unnecessarily 
circuitous. Would it not be just as easy - with some general informa- 
tion about the student group - to concentrate directly on the second stage 
of the goal-analysis? There arc naturally quite a lot of cases in which 
the use of this shorter procedure is plausible. 

There are two main arguments, however, in favor of a fioquent use 
of the more detailed two-stage procedure. The process becomes more 
explicit, which reduces the risk that hitherto unexplored possibilities 
are neglecteu simply because of tradition (the usual pattern for teach- 
ing a particular student group, e. g. a particular age group). Secondly, 
it is not necessary to f>tart working from the beginning again as soon 
as one wants to build up a new course in the same field for another 
group of students (the first stage remains intact, as a foundation for 
future work). 

6. 1. 3 Further Points to be Considered in the Student Analysis 

So far we have for the most part only discussed student analysis from 
the point of view of concrete previous Imowledge in the field to be dealt 
wi*-h in the course. The student naturally has many other important 
sides, which should as far as possible be known and taken into consi- 
deration from the start, when the course is being planned. Examples 
which can be given are the students'" level of intelligence, reading ability, 
general background experience (which can then be used continuously for 
illustration and association), together with their purpose in studying 
(and subsequent study-motivation). 

Some early studies (see e. g. Little, 1934 and Porter, 1959) seemed 
to show .little connection between the intelligenc e of the students and the 
results they achieved in programmed teaching. This gave rise to opti- 
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mistic ideas that programmed teaching would wholly eliminate the 
significance of varying levels of intelligence in learning. The only 
difference would be in the length of time taken to learn by these with 
greater or less ability. The correlation between intelligence and student 
results in current teaching was seen as an expression of that teaching^'s 
instructional inefficiency: what a student got out of a course depended 
moot on v/hat he '‘took with him*' to the course. It v/as thought that if 
the course were j^lanncd more efficiently, it should communicate its 
message regardless of the level of intelligence of the students. 

Experienced teachers found it difficult to accept this excessive opti- 
mism and later studies (c. g. Silbermon, 1961; Shay, 1961) seemed to 
show that the conclusions mentioned above were premature. Naturally, 
the individual rate of work and the student -guided flow of information 
can result in the disappearance of some “unnecessary" failures. The 
inability to grasp an account quickly should have less significance in the 
use of self-instructing study material than in conventional teaching. But 
the idea that general intelligence should suddenly, as if by magic, cease 
to have any relation to the ability to learn must, for the time being, be 
dismissed as wishful thinking. 

The significance of this in more concrete terms for the planning of 
courses is partly , that the average intelligence of the target population 
must be taken into consideration both in the wording and in deciding the 
"density of information" (more about tlais in a later context), and partly 
that an attempt should be made to judge whether or not the target popula- 
tion is very heterogeneous with regard to intelligence. In many cases 
those taking part in a course form a relatively homogeneous group and 
then there is usually no reason for working with parallel courses. In 
some cases, however, the variation is exceptionally great. It can then 
be worthwhile to consider either parallel co urses with varying degrees 
of "information-density" or a course with branching (e. g. with additional 
built-in repetition for those students who prove to need this). This point 
will be discussed further below in connection with the concept of "flow- 
model". 

Reading ability, perhaps in particular the command of vocabulary, is 
obviously of great importance if the student is to be able to assimilate 
a certain study-material. Even the ordinary text-books are usually care- 
fully ado.pted to the reading ability of the target population. But in self- 
instructing material this aspect is of even greater importance. Here, 
unlike in ordinary classroom teaching, there is iio teacher available to 
explain the parts that are difficult to understand. Reading comprehension 
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teste for representative groups of the target population can in this con- 
text play a useful part at the planning stage. This question should natural- 
ly also be kept in mind during the successive testing of the preliminary 
version. 

Acquaintance v/ith the general background experience of the students 
is important because it makes it possible to provide meaningful illustra- 
tive material and ’’correlative stimuli” (to make use of the terminology 
used above) which promote learning. 

Certain series of associations are natural in some ’’symbol environ- 
ments”, but completely foreign in others. If one is acquainted with the 
target population's common symbol environment (determined partly in 
an adult group by education and vocational experience), then it is easier 
to formulate the teaching material in such a way that it fits in with the 
conceptions the students already have. This is the best way of using the 
”net of associations” which the students have already acquired to bind 
the new material in the ’’repertoire of associations”. If possible, one 
shoiald try to get some idea of the natural "symbol environment” at the 
preparation stage and then all later revision v/ork should obviously be 
guided in part by how well one has succeeded in rmking use of the student 
group^s background experience. 

The targat population's particular purpose in studying is natur- 
ally of significance for the level of motivation. If there is rm real per- 
sonal purpose behind the studies, i, c. if they are compulsory, it may 
be necessary to incorporate special measures to promote motivation. 

In such cases, it becomes even more important to associate to the 
student^s own experience and to use examples which make him feel that 
the material can - despite everything - be relevant to him personally. 
Sometimes an item should be treated from different angles for people 
with different study-purposes and different interests. If such groups 
with clearly separate interests occur within the student-group in questio^i 
it may be necessary to construct parallel versions of the course mate- 
rial for some sections of the course (for more on this, see belov/). In 
general, the main aim - both when the group is relatively homogeneous 
in purpose and when various sub-groups have different purposes - should 
be to make the study material as "consonant to purpose” as possible. 

If this is done consciously and according to a clear plan, there is a 
greater chance of achieving positive gains in motivation and thereby 
also maldng the proc ss of learning more efficient. 

Less essential - but not without importance in some contexts - is 
the fact that the purely external form of presentation can create an ir»- 
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tcrcst in studying which the study-material in itself does not provide. 

An example of this is the mechanical form of presentation which, by the 
process of manipulation involved, creates an additional interest in the 
same way as a gambling machine. The most important thing is naturally 
always to make the study-material interesting in itself, but these ele- 
ments used to heighten interest should 'not be despised if they really 
prove to be effective and are at the same time easy to produce. Often 
it is not the mechanical manipulation in itself which is interesting, but 
the fact that the machine gives continual information on what has been 
achieved. Like an automatic target, it shows immediately - sometimes 
by means of a dramatic light or sound signal - how an attempt to solve 
a problem has succeeded. The value of such obvious prais e - signals for 
the motivation of students who are nervous and anxious to succeed should not 
not be underestimated. But naturally the individual differences should 
not be forgotten here either. A process which amuses and heightens the 
motivation of a boy in the lower forms of the comprehensive school can 
very well be an unnecessary source of disturbance and irritation to an 
educated adult with a clear purpose in studying, who is used to dealing 
v/ith complicated tasks independently (without the support of someone who 
shouts 'Bravo!' at every stage). 

To summarise, the main questions which anyone constructing study 
material must ask himself in connection with the student analysis arc: 
a) Docs the group have ’’previous Icn owl edge” v/hich makes some of the 
items included in the goal - specification unnecessary? b) What limits 
do the general intelligence and reading ability of the target population 
set for the degree of difficulty which can be used in presenting the 
material? c) In what way can knowledge of the students^ background 
experience and purposes of study be used to make the material more 
efficient? d) In what way must the nature of the ’’medial situations” 

(what the student docs in the interval between the study- situation and 
the terminal situation proper) be taken into consideration when the 
course is planned? c) To what extent can an analysis of probable ’‘inter- 
ferences” help us to pick out the items in the course which need most 
practice? f) Docs the student-group vary in different respects - intellig- 
ence, reading ability, background cxpciicncc, purposes of study etc. - 
to such an extent that parallel courses or courses v/ith different branches 
become necessary? We may also at this later assessment be forced to 
accept that some parts of the content of the goal-specification arc too 
difficult for some section of the student -group. 
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6. 2 SITUATIO N ANALYSIS 

\7 c should, on the basis of the prerequisites given us by the goal ana- 
lysis and the student analysis, try to create an adequate external teach- 
ing situation. If on this basis we can decide upon the most effective forms 
of presentation, v/e can acquire the aids we need in order to present the 
material in this particularly effective way. And if, on the basis of goal 
analysis and student analysis, we can establish the time needed to reach 
the goal, then we can use this in deciding the time - structure of the 
course. Etc. . In other words, we let the external organisation of the 
teaching situation emerge naturally from the analysis of what is most 
rational instructionally. 

The educational '‘rationalisation expert" seldom works, however, in 
an environment that is so flexible tha^. he can immediately have all his 
wishes fulfilled; no matter how well -documented they are. On the 
contrary it is usually so that financial resources, available aids and 
specified lengths of time for courses are already fixed or can in each 
case only be influenced to a limited extent at the moment when the 
course is being planned. While plainly declaring v/hat in his opinion 
would have been the most rational procedure, he must nevertheless 
see it as his task to make the best possible use of the resources avail- 
able (in the question of time, aids and money, for example). 

This means that an analysis of these external restrictions on the use 
of the study-material must also be included in the original preparatory 
work as factors to be remembered in the final selection of material 
and in assessing which presentation media etc arc economically feas- 
ible. But these assessments should be kept clearly separate from the 
more rational considerations. 

External restrictions must not gain such a foothold in the construction 
of the course that accidental circumstances at the beginning of the course 
gradually become tradition and arc afforded the status of definite prin- 
ciples. This is possibly one of the greatest difficulties involved in con- 
structing self-instructing material. The course must often be started 
in a very special "compulsory situation". The work of constructing the 
material is extensive and costly and one has no desire suddenly to tear 
up what one has created. And then as a result one has perhaps helped 
to preserve an unfortunate initial situation instead - as the intention 
was - of making a contribution to the continuing pedagogic development. 

If only one is aware of this danger, however, it should be easier to 
avoid it. One way is to keep a special record of emergency measure^ • 
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measures taken because of external organisational circumstances, not 
based on rational pedagogic considerations - and then to use the record 
continually in the battle for a more rational state of affairs. This 
also leads naturally to revision of the working program as soon as 
this battle succeeds on some front* 
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7. SUBJECT-MATTER ANALYSIS 

The analysis of objectives gives a general survey of the terminal 
behavior which a specific instructional material is intended to lead 
to and involves tlicreby, a!: least implicitly, a preliminary delimitation 
and determination of its content. But before proceeding from this first 
delimitation to the actual writing of study material, however, a more 
detailed analysis of the subject-matter sho uld normally be made. The 
main purpose of this analysis is to obtain a more thorough understand- 
ing of the logical and psychological structure of the subject-matter , 
with a view to deciding on the most effective instructional presentation. 

The detailed procedure of this analysis must differ to some extent 
from case to case, depending on the general aim of the particular 
course and the suitability of the subject-matter in question for a 
particular analytical procedure. The following description, therefore, 
gives only *'^n example of a method of evaluation which can be useful 
in this connection. It should be added that in certain cases it is also 
possible to proceed more directly from the analysis of the objectives 
and the analysis of the stadents to the writing of study material. While 
a detailed goal analysis is a.lmost always necessary, a subject-matter 
analysis of the type we shall illustrate here should be regarded rather 
as an aid and check than as an absolute necessity. 
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7. i EXAMPLES OR PROCEDURES FOR ANALYZING LOGICAL 
STRUCTUP.E OF CONTENT 

An analysis of the logical structure of content is obviously most easily 
applied to those subjects in which the logical structure is relatively 
fixed and fundamental. This is especially true of mathematics and 
certain scientific subjects. But sometimes this analysis can be more 
useful for subjects in which che logical structure is not so readily 
apparent in our conventional textbooks. In the lattei- case it is 
sometimes possible co make a radical improvement, after a study 
of the central structure of the subject, by getting rid of much 
unnecessary a.nd distracting matter which is neither relevant to the 
objectives nor fulfilling any clear function as "instruction facilitators" 
on the route to the goals. 

Some natural stages in such an analysis can be: (a) working out a 
list of the basic units of the area covered by the course, usually 
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''concepts (b) trying to arrange these basic units in a logically 
meaningful sequence, normally within a hierarchical system; and (c) 
studying other logical relationships between the basic units in order 
to choose such "relational pairs" as are particularly significant from 
an instructional point of view. 
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7.1.1 The "C- Catalog^ue " and the Preliminary "S-List" 

From a logical viewpoint it is normally natural to break down the 
content of a subject into fundamental concepts (here referred to as 
a-nd statements of different kinds about these concepts (here 
referred to as "S"). In a course on grammar, for example, it would 
be reasonable to regard such terms as "noun", pronoun", "subject" 
and "predicate" as " C units " and a statement of the type "Nouns and 
pronouns can function as a subject" could be regarded as an "S unit" 
or "statement" as it is used here. The "statements" often express 
relationships between the basic concepts. 

Among the advocates of a logical analysis of course material we 
can mention Evan, Homme and Glaser, whose analytical procedure is 
usually called the "Ruleg" system, since it is built up on "rules" and 
"examples". A number of ideas from the "Ruleg" system have been 
incorporated in the present discussion, but we have thought it natural 
not to limit the analysis to "rules" and "examples" (which are often 
relatively complex from a logical point of view) but prefer to start 
from somewhat more basic elements ("low-level units"). 

It is often expedient to have an expert in the particular subject area 
work out a detailed " C-catalogue " for the area delimited by the list of 
"terminal behaviors" decided upon. Every item of behavior in this list 
is examined, in this process, with the following question in mind: 

Are there one or more concept-units of which the students should have 
knowledge to be able to act correctly (and with sufficient flexibility)? 
Each item of behavior can imply a large number of different concept- 
units, but on the other hand, of course, a whole series of items of 
behavior may be connected with one concept or the same group of 
concepts. In other words, no one-to-one relationship exists between 
behaviors and necessary concepts. V/e should like to be certain that 
this analysis is made in a unprejudiced manner and without reference 
to current textbooks and similar study sources. The work at this stage 
should therefore be carried out as far as possible by experts at the 
highest level. 

63 



-7.3- 



As a practical matter of technique, it would be an advantage if 
each separate concept were noted down (by means of a ’*key-word*< 
together with any necessary explanation) on a separate card (”C-card’'). 
The obvious advantage of a card-index here is that later on it will be 
so much simpler to handle the basic units when it comes to examiriiig 
the relationships between them. This collection of C-cards constitutes 
the ^^ preliminary C»-cata l ogue '* and thus implies a breaking-down of 
the total content into logical units. 

\ 

Before this collection of concepts is used for structural studies, 
it would be advisable to check and supplement it by comparing it with 
existing source material in the field, as it is possible that the subject 
specialist may have overlooked certain significant concepts. But this 
** source confrontation *' should be the second stage in the work, not the 
first. (If one starts from source material, one risks losing the 
advantage of the survey of essentials made by the expert and runs the 
risk of being unnecessarily restricted to traditional approaches.) 

The the subject expert makes a "preliminary S-list", i. e. writes 
down the special relationships (rules or laws) which, in his opinion, 
should be taught (in order to prepare the students adequately for 
reaching the instructional goals listed). 
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7.1.2 The "Sorted C- Catalogue " 

The next stage is to try to arrange these basic units in a logically 
meaningful sequence. One of the simplest and most natural ways of 
doing this is to systematize the basic units into a hierarchical system, 
i. e. by grouping the cards within a system of superior and inferior 
classification categories. 

A simple procedure is as follows: The total content is divided 
up under a number (perhaps between ten and fifteen) main headings. In 
choosing the main headings, one is partly guided by an examination 
of the data from the goal-analysis and partly by going through the 
unsorted C-catalogue. The main headings are written on demarcating 
colored guide-cards, and the single C-cards are sorted under these 
different headings. Each of these main sections is then split up into 
a number of sub- sections , each with its own sub-title. The sub-titles 
are written on guide -cards of a different color and the C-cards then 
sorted into these smaller divisions. A further sub-classification is 
then carried out, in which a third color is used for the headings of 
these new sub-categories. This sub-dividing is continued as long as it 




appears to be fruitful for the particular material being handled. 

Finally, the individual cards are arranged in a logically meaningful 
sequence within each category. 

The result of this procedure is that the logical basic units in the 
“Sorted C~catalogue“ have been arranged in a hierarchical scheme 
of tlie general type, as shown in Figure 7,1, 

As an aid to finding one^s v/ay quickly about the catalogue, one 
might use a predetermined color scale for the guide-cards, e,g, from 
“warmer** colors for the broader categories to **colder*' colors for the 
more limited ones (in accordance with a suggestion by Mechnerf 
cf, Glaser, 1962), Such working details are, however, a matter of 
individual preference, and are obviously of no critical significance 
for the main purpose, 

7. 1,3 **C-Matri. ** for Ex plor ing Relationships 

It is convenient to number the individual cards in the sorted C-catai.;jue 
in the order which has been established. Starting from this fixed 
sequence, a “C-matrix” is then built up. This consists simply of a 
system of cells whose row and column headings are designated by the key- 
words of the individual C- cards. In other words, the key- words on the 
C-cards are entered in numerical order from top to bottom in the left- 
hand heading column of the matrix and in the same order from left to 
right along the upper edge of the matrix, 

A cell in the matrix is taken as symbolizing all conceivable 
relationships between two concepts as shown schematically in Figure 
7,2, The main diagonal is of little interest in this connection and has 
been marked with an X, The first row gives the relationships between 
concept C and other concepts. The second cell in the first row thus 
gives the relationships between concept and concept C^, In the 
same way, the third cell in the same row gives the relationships 
between concept and concept C^, and so on. The lower left-hand 
half of the matrix forms a mirror -image of the upper right-hand half, 
in so far as the same pairs of concepts are repeated. For some 
purposes, however, the **direction** of the relationships is significant, 
and in these cases the two halves are not identical: in the upper right- 
hand half of the matrix tlie “first** component of each pair is the unit 
with the lower sequence number, while in the lower left-hand half 
the “first” component is the unit with the higher sequence number. 



The main purpose of the C-matrix is to serve as a starting-point 



for systematic exploration of the relationships . The basic question 
which should be considered throughout the examination is: In this 
particular relationship such that it should be used for instructional 
purposes ? The constructo3* can, for example, go through the matrix 
cell by cell asking himself: What connection is there between these 
two concepts, and is the connection of a type which can be used in 
teaching? Or perhaps he can ask; Is there a basic difference in 
character between these two concepts of such a kind that it can and 
should be used instr uctionally in preparing the study material? 

A separate matrix could be used for each type of relationship one 
wishes to explore in this way. One would then produce a matrix book, 
in which the individual pages represent different types of conceptual 
relationships. Usually, however, such a procedure is unnecessary, 
and in many cases it would be of practical value to record the different 
types of relationship on one and the same matrix, so that they can be 
seen at a glance and readily compared. One perhaps decides first of 
all to mark with a on the matrix those cases in which a certain 

type of causal connection is of instructional interest and with an '^O'* 
those cells in which a differential relationship is pedagogically 
interesting. At the same time one can decide to enter a "D’‘ in the main 
diagonal of the matrix for concepts for which it appears specially 
important to give a clear and detailed definition. A C-matrix used in 
this way might after the exploration look like that shown in Figure 7.3. 

A well carried out exploration of the C-matrix guarantees to some 
extent that the original sequence order according to the hierarchical 
pattern doer, not lead us to forget important and instr uctionally valuable 
relationships of other kinds. Thus the two ways of studying the 
material supplement each other. 

7.1.4 Comparison Between '*C. C-Cards" and the ’^Preliminary 
S-List »» 

Working from the C-matrix which has been marked up in the above 
way, the constructor makes a series of additional cards. Each of 
these takes up one of the conceptual relationships which has been 
marked on the matrix as instr uctionally interesting. The extra cards 
- called "C. C-cards” - are then compared with the previously 
mentioned ’’preliminary S-list”. The latter can be regarded as a 
”C. C-catalogue" which is based on general teaching experience, but 
has not been examined in detail from a logical point of view. 
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A comparison of both collections should in many cases be 
instructionally rewarding. In a number of cases •• especially when the 
subject material in current text-books has been logically well worked 
out - the difference between the collections is perhaps not pa rticiilarly 
great, and the contribution of the C. C-catalogue is then more modest. 

In these cases it is primarily an extra check and confirmation that no 
important logical connections have been missed. In other cases - 
perhaps especially when there is relatively little instructional experience 
in the particular field - the differences between the two categories can 
be rati . ..amerous. 

A number of these discrepancies will probably indicate that certain 
of the statements recorded in the preliminary S-list have no equivalents 
in the C. C-catalogue, One should then ask oneself: Has this gap in the 
C. C-catalogue occurred because, in going through the C-matrix, one 
has omitted to record an important relationship (this kind of thing 
naturally does happen), or is the discrepancy a more important one? 
Must certain propositions in the preliminary 3-list be considered, on 
second thoughts, hardly fundamental from a logical point of view and 
dealing with only superficial connections? But most often the majority 
of the discrepancies between the S-list and the C. C-catalogue will 
probably be in the opposite direction, that is, several relationships 
which do not appear in the S-list will come up in the C. C-catalogue. 

This would also be the most valuable result from the instructional point 
of view. Under optimal circumstances, such an addition can mean 
a really fruitful collection of suggestions for fresh pedagogical 
approache s . 

In many cases the final step in this stage of the work would be to 
insert the C. C-cards (after possible corrections and additions through 
reference to the preliminary S-list) in suitable places in the ^‘Sorted 
C-catalogue A good method of doing this is, for example, to insert an 
individual C. C-card immediately after the C-card which describes 
the last component of the relationship (in other words, at the earliest 
point in the sequence at which both components have been introduced). 
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Main categories 
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Figure 7. 1 Example of tl)e principle for constructing the ^'Sorted 
C -catalogue’’ 

Note: For the sake of surveyability , categorization has been corriple- 

ted for only a small part of the structure (proceeding from X. .) 
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Figure 7. 2 *'C -matrix” ; General characteristics 
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Note: The marking of this matrix shows that the constructor considered it 
important 

a. to give a detailed definition of concepts C^, C^, Cg, and C^; 

b. to use instructionally a certain type of causal Relationship between 
concepts C ^ and C ^ and Cg, and Cg, and etc. ; and 

c. to use instructionally differences between concepts aind Cg, au^ 
between Cg and 
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7. 2 SOME REFLECTIONS ON PS YCHQLQGICAL SUPPLEMENTATION 



O F THE EQGICAL ANALYJIS 

Some readers may perhaps by now have a feeling that the treatment of 
material we have just desc .-ibed places far too much stress on logic, and 
are perhaps inclined to object that it is not after all the logical approach 
that is most important. The essential thing is to present the material 
in a psychologically suitable and ins true tionally effective way. It is not 
at all certain that what has been broken down to its logical essentials 
is necessarily the most effective type of material for teaching purposes. 
Is there not a risk of involving ourselves again in a “pedagogical 
logicism“ corresponding to the exaggerations of the Herbart- Ziller 
teaching methods - a logicism which has rightly been rejected by 
modern educational reformers on grounds of developmental psychology? 
Getting rid of what is logically unnecessary can perhaps mean that one 
removes both extra material which arouses interest and “redundant” 
material which promotes the learning process, i.e. which is superfluous 
from a logical point of view, but is essential for teaching because it 
gives the students the necessary repetition and time for familiarization. 

Such objections would certainly be valid _^the intention had been to 
restrict the constructor's work to logical analysis and to let this decide 
the final form of presentation. But this is certainly not the purpose. It 
is intended instead that the logical analysis should be a first step giving 
a better understanding of the structure of the subject-matter, so that 
the constructor of study rri.aterial is perfectly clear about his “focal 
stimuli", i.e. what basic concepts and fundamental relationships he 
should bring forward. This is obviously not the same as saying that 
the study material should be presented in this way (pared down to 
logical fundamentals). The method of presentation has to be treated 
in a second step and is a question of instructional suitability, which 
is likely to be answered in different ways for different groups of students. 

Obviously, additional “interest-arousing" material must often be 
introduced to increase motivation and for illustrative purposes. 

Similarly, it is clear that repetitive material must usually be 
included. But such additional material should be inserted 
consciously and systematically. Any form of “filling -in“-material which 
is not in itself focal - should have a clear instructional motivation and 
not be there by chance or because one has only a hazy notion of what one 
really wants to achieve. If this degree of rationality and awareness is 
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to be attained, it is frequently necessary to begin by ‘logical stripping‘1 
But of course this does not mean that one stops at this point and adopts 
mere logical nakedness as a^n instructional ideal. 

We shall return to the question of the educationally and psychologi- 
cally most suitable form of presentation at several points in our 
discussions below of how the preliminary version of the study material 
should be constructed. 

In the present section, however, it is possibly worthwhile to 
stop and consider briefl/ the more general question: It is possible to 
make a psychological analysis of the subject-matter in such a way 
that it will give a better starting-point for choosing instructional 
procedures; and which methods of analysis will be most fruitful? 
Unfortunately our psychological knov/ledge.hn this field is still scanty, 
and many problems await deeper study. 

In general, we can say that a psychological analysis of a particular 
subject-matter for teaching purposes will often amount to an analysis 
of the possible and desirable interactions between a student and the 
subject - content. In other words, it involves a study of the relationships 
between the specific subject-conto-it as stimuli and the student'^s 
response reactions. If tho logical basic unit can in most cases be 
considered to be the “concept”, the psychological unit would normally 
be the individual stimulus-response connection, i. e. a behavioral unit 
with its stimulus conditions. 

In such an analysis, hov/evor, it should not be forgotten that the 
human learning process is characterised to a high degree by its 
complexity and by parallel learning on different “levels”. To describe 
the learning process simply in terms of separate S-R connections often 
implies, therefore, an over- simplification, which is not well suited to 
guide our decision on teaching strategies. 

From the point of view of instruction it may often be worthwhile 
to observe four different types of learning that go on more or less 
simultaneously: (a) the learning of separate “subject-matter items”, 

(b) “field articulation” or the learning of “subject-matter systems”, 

(c) the learning of “subject-matter treatment techniques” (study habits, 
problem solving approaches etc.), and (d) the learning of “subject- 
matter attitudes”. 

/ jL 
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To make our reasoning clearer and more precise, let us introduce 

some sample symbols and give some examples: 

US = undifferentiated stimulus 

FS = focal stimulus 

NS = non- focal stimulus 

CS = correlative stimulus 

PR= pupil's reaction (response behavior) 

> = associative connection (with the general meaning ’’is followed 

by’^ ’'gives rise to” etc. ) 

temporal development (from before learning to after learning) 

We should then be able to exemplify some common types of learning 
in the following way: 



a. Learning ’’subject-matter items”» I: One-way connection . Here 
the learning process consists of practising the correct reaction to a 
given stimulus without reference to its sequence or position in a system. 



FS^ ■> PRa 

b. Learning ’’subject-matter items”, II: Reversible connection . 
Here again it is a question of reacting adequately to the correct 
stimulus. In this case, however, the association can take place in both 
’’directions”. What at one moment is the response Z to stimulus A 
should be able to function, when necessary, as stimulus Z and then 
result in response A. A typical case of this reversible association, 
to give a concrete example, is obviously the learning of vocabulary in 
a foreign language, when a normal requirement is skill in translating 
both ways. When teaching English to a Swedish child, for example, 
not only must a Swedish word (sw) be able to produce the English 
equivalent (eng), but the English word must also produce the Swedish 
one. 



e. : 



FS 



sw 1 



FS 



^eng 1 
eng 1 






c . Learning ’’subject-matter items”. III: Disconnection of supporting 
stimuli . Learning often implies a development from a correct response 
after maximal help to a correct response with a minimum of assistance. 
Expressed in terms we have used elsewhere, we are here concerned 



, e. : 
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It is often, of course, a question of a procedure with several inter- 
mediate stages of this general type: 



FSi 'N 

C-i.l 






FS^ 

CSi.i 






CO 


CSj 2 




CSi.2 
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s 
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PR 



d. Learning ‘^subject-matter systems**, I: Sequences. A ( nmmon 
form of learning, which goes beyond learning one item at a time, is 
the practice of ’’chain-connections”. In this case we havJ a serie:^ of 
stimulus-reaction connections, in which the internal order is important, 
and in which the response in the first stage becomes the stimulus for the 
next: 



I. e, : 



FSj— > 



PR 

FS. 



PR. 

FSo 



_>PR3 



etc. 



e. Learning ’’subject-matter systems”, II: Refined discrimination. 
Even one-way association implies a certain form of discriminative 
learning (practising the right reaction to the correct stimulus, when 
this stim^ilus must be selected from among a large number of other 
stimuli which are irrelevant for the response). What we are considering 
here is something else: a differentiated reaction to separate parts of 
a larger complex which hat. previously been experienced as unitary 
as far as reaction is concerned. In the uncomplicated association, we 
have a simpler figure -ground relationship, in which a focal stimulus 
is given a certain content and is brought sharply into focus while other 
stimuli recede into the background. In this refined discrimination we 
get an increased differentiation within the focal sphere. We proceed 
from undifferentiated wholes in focus to differentiated wholes in focus 
(while retaining experience of the whole). 



e.g. : 
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Continued differentiation can naturally also result in the sorting out of 



some part of the whole as not being relevant: 
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f . Learning **subject-matter systems^S III; Increased generalization . 
Another type of learning implies the ability to see the connection 
between phenomena which have previously been experienced as separate. 



The above descriptions should be looked upon as exemplifications, and 
not as an exhaustive survey. In addition to these types of learning, 
there are of course, as we have already indicated, the learning of the 
techniques of handling the material (methods of study) and attitudes 
towards the material, commonly going on simultaneously. 

It would be useful in several respects to carry out, at the 
preliminary stage, analyses of the types considered here, and in doing 
so the possibility of an empirical study of students^ reactions should 
be borne in mind. An examination of the desired stimulus -reaction 
connections prevent the importance of some type of connection being 
overlooked. For ex; mple, if it is necessary for the student to be 
able to behave in terms of reversible connections within a particular 
area, the training should normally be so designed as to give room for 
training botli "directions". Empirical data indicate also that this is a 
correct procedure. Usually there is not much transfer from "one-way 
training" to behavior in the "opposite direction". 

It is particularly important not to concentrate so closely upon 
learning subject-matter items that simultaneous parallel learning 
processes of other kinds are neglected. It 5s often the case that learning 
of items can take place in many ways with greater or les.«er efficiency 
(time taken). But some of these ways demand simultaneous learning 
of subject-matter systems (e.g. generalization or differentiation), 
while others do not. Similarly, some learning processes are valuable 
for the development of individual study techniques, while others can be 
less valuable from this point of view. 

Frequently a method which results in a relatively small increase in 
effectivity as far as the learning of items is concerned may well at the 
same time lessen the possibility of learning a. good study technique. 

In subject-matter analysis, therefore, the questions to be considered 
are not only: What material should be chosen? In what order should it 
be presented? We must also ask; What type of behavior do we require 
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from the student when he is confronted with the study material? Do we 
ask him to copy given information, do we let him guess the answers, 
or do we help him to think out the solution to a problem? If the 
programmer is constantly aware that he must ask himself this double 
question (*' Which way to the information?*' and "Which information?"), 
he should run less risk of finding himself imprisoned in a one-sided 
programming routine. 
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8. CHOOSING MEANS OF PRESENTATION 
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8, 1. SOME PROBLEMS IN TERMINOLOGY 

Like many other terms in the field of educational technology, the word 
’’teaching machine” has caused a great deal of confusion: (a) The term 
has aroused undeserved negative reactions because in the minds of ma- 
ny it is strongly associated with automation and ’’soulless” mechaniza- 
tion. (b) It has. in innumerable discussions, been difficult to distingu- 
ish between ’’teaching machine” with its special meaning for the pro- 
grammer and the teaching machines of other types which have already 
been in existence, such as presentation aids in the audio-visual field. 

(c) It has sometimes been difficult to define a clear and definite bound- 
ary between "teaching machines" and program presentations in book 
format. In some contexts, consequently, the programmed textbook has 
been presented as one type of "teaching machine". 

The first-mentioned point, a, is perhaps of least importance in 
principle, although at the present moment it does have a certain bear- 
ing on our communication to teachers and other groups. We can be 
fairly safe in assuming that mechanical aids of different types will 
gradually become so much a part of our surroundings (and hopefully so 
well ^axLa:pte d to human needs) that they will lose their "threat” image. 

The two other points, b and £, concern, on the other hand, tangible 
conceptual obscurities which it would be advantageous to have cleared 
up. In this presentation we do not want to give definitive suggestions 
for general use. But when we, within the frame of our present dis- 
cussions, wish to achieve a fair degree of precision, we shall use the 
following terms with the meanings set our below; 

The term " presenter " is used for arrangements whose rrain func- 
tion is to present to the student a certain pre-arranged stimulus -se- 
quence. Oextadn presenters have tangible mechanical components 
(ex. wheels and/or levers). To this group belong projectors for lesson 
material on film strips, tape recorders for lesson material on sound - 
tapes, TV sets for TV lessons, etc. Several so-called "audio-visual 
aids” can be considered mechanical presenters when used as they ordi- 
narily are at the present time. Presenters of a non -mechanical type 
have long been in use in teaching. Large pictures and maps (for group 
demonstrations) and textbooks (for individual use) can ordinarly be count- 
ed as belonging to that category. 
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The term ** reactor* * is used for those arrangements whose main 
function is to offer the student the opportunity of making a response 
reaction. The "question book" in the form of practice tests or work 
sheets illustrates a non-mechanical system. We find the mechanical 
type in various so-called "feedback systems " (or "teletest systems") 
which include student sets for response reactions (pres s -a -button type) 
(making possible individual and group combined "reaction totals"). 
Simpler forms (which do not offer the possibility of getting individual 
reaction totals) are also available. 

Of principal importance for the auto-instructional system is, how- 
ever, that the question is not one of presentation only or of reaction 
alone, but of a constantly alternating sequence of presentations and 
reactions . An arrangement or system, mechanical or non -mechanical, 
the purpose of which is to offer the student progra.mmcd teaching with 
such an alternating sequence, could be described by the general term 
" integrator ". If the arrangement in question is built up of mechanical 
parts, then we arc correct in referring to it as a " teaching machine ". 

If it does not have any mechanical parts at all, it will suffice in many 
cases to apeak of a " programmed workbook ". If we wish to avoid 
entirely the term "teaching machine", and if we in any case want more 
specific terms and are not afraid to coin new words, then we might 
use the term " tutof or " as a general name for an arrangement based on 
programming and facilitating systematic alternations between presen- 
tations and reactions (^integrator) and use the terms " tutoma t" for 
mechanical arrangements and "tutoprint" for the non-mechanical. See 
Figure 8. 1 for an outline of our terminological suggestions. 
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8. 2 CHOOSING BETWEEN MECHANICAL AND NON -ME CHANICA L 
ARRANGEMENTS 

The author of auto -instruc tional course material must decide in the 
preparatory phase the form which he intends to use in offering the pro- 
gram to the student, since different forms of presentation require to 
some extent different patterns in detail work. It is, of course, desir- 
able that the choice of the form of presentation be bas«^d on data from 
the current goal analyses and the student analyses, and that the actual 
technical aid situation aid situation at the time is not taken into consi- 
deration until the final round. In order to make a judicious choice, the 
person who b^s this responsibiHty must kepp up-to-date with the rapid 
developments in the field of teaching aids and must try to choose cri- 
tically from the announcements of the hawkers in that particular mar- 
ket, who are more often than not considerably louder than they are in- 
formative. 

What, in principle, arc the advantages which mechanical program 
presentation has to offer? In which respects can it increase effectivity 
in the auto -ins tructional context? 

Obviously the debate for and against mechanical teaching systems 
has often raged with more intensity than objectivity. At one extreme 
are those who believe that programmed teaching cannot function with- 
out mechanical help. In this group we find - besides some manufactu- 
rers of machines - principally those who lay great stress on the ma- 
chine's function as a discourager of cheating. At the other end of the 
continuum arc those who claim that mechanical aids arc an entirely 
su-pcrfluouG ’’frill". In this group we have most likely a considerable 
number who react negatively and emotionally to instructional innova- 
tions in general and to instructional apparatus in particular. In this 
group can be found persons who quite simply find it "inhuman" and 
"soulless" to place a student in front of a teaching machine (but who 
seldom call constant use of sarcastic criticism from a teacher "in- 
human" and seldom or never consider it "soulless" or meaningless 
to force students who have already mastered certain material to listen 
to the teacher^s repetition of it for the benefit of those in the group 
who are not so advanced). 

But this resistance group to machine teaching also includes more 
reasonable critics. They arc ab “'Vc all anxious that which is good in 
the basic principles of programming and which often can be put into 
effect in a well-planned and adequately tested workbook should not be 
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lost in misplaced enthusiasm for the surface glamour of the impressive 
machines with all the pushbuttons (which can, of course, easily be shown 
off to admiring and not so well-informed visitors, thus giving the organi- 
zation or school an easily earned reputation for keeping up with the times). 
Through the industrious use of such expressions as "complicated page- 
turners" (for branching machines) and "hard plastic book-covers" (for 
linear machines) and by means of the somewhat tiresome but helpful re- 
frain that "it is the program that is most important", a number of these 
critics have contributed to a more realistic view of mechanical arrange- 
ments. They have brought teaching machines back down to earth again 
and have prevented the myth of the "emperor^s new clothes" from spread- 
ing in too wide circles. 

The most reasonable attitude at the moment seems to be that many 
types of existing programs should function very well for many student 
groups without any mechanical components at all - and this has also been 
demonstrated by repeated empirical tests. This does not)^ean, however, 
that mechanical aids for other types of programs and other groups of 
. students cannot increase effectivity and even be essential for certain 
types of programs. Those par ticipating in these discussions have too sel- 
dom taken into consideration the great differences in the terminal situa - 
tion, both as to type of stimuli and type of reaction . 

For example, it is quite obvious that a self -instructional program in 
a foreign language could not be made very effective if only visual presen- 
tation of word pictures and objects as well as written answers were used. 
Here the auditive stimuli as well as the auditive -oral interaction between 
the tape-recorder unit and the student are a fairly obvious mechanical 
supplement. 

Mechanical components are often just as natural and as essential 
when the terminal reactions are of a manual -motor type. We can no more 
renounce mechanical components in teaching manual proficiency in an 
auto-instructional teaching situation than we can in an ordinary teacher- 
instructional situation. For instance, we do not train a typist without a 
typewriter or a punching -maciiine operator without a practice punching - 
machine. 

One of the best known "student-adapted" types of teaching machine 
is "SAKI" (constructed by Gordon Pask; cf Lewis & Pask, 1965, and 
Figure 8, 2), "SAKI" was designed for learning different types of key- 
boards. The special keyboard on which the student is going to practise 
is connected to the system which, in addition, has a presentation unit 

80 



^ 8 . 6 - 



and a program -and-registcring unit. If the student is to practise card 
punching, then a punch -card keyboard is plugged in to the circuit. The 
presentation unit has two parts: the upper with rows of numerals in se- 
quence and the lower with numbers arranged as they are on the keyboard. 
The student presses down on his keyboard ("response unit" in the figure) 
that key which has the same marking as the light signal which flashes 
on the upper part of the presentation unit. As an extra aid for the stu- 
dent in identifying the right key, an extra light signal is given in the be- 
ginning in the lower part of the presentation unit (from which, of course, 
the position of the key is easily seen). When the student has pressed 
the key both lights go out and a new pair of stimuli is offered. The num- 
ber of correct and incorrect reactions are registered, and can be 
seen on the feedback unit. The tasks increase successively in difficul- 
ty as the student gains in assurance and speed, partly through faster 
presentation, partly by successive fading, and finally complete discon- 
nection of the lower part of the presentation arrangement. (It has been 
demonstrated that this set-up can produce good results in teaching 
without an instructor, although not necessarily better than the results 
attained with a combination of instructor plus practice punch; Randell, 
1963 . ) 

The manual training situation can also in an indirect way lead to 
the decision that it is desirable to use some sort of mechanical presen- 
tation. Many manual practice situations are such that the student^ s 
hands and eyes are busy performing a certain task (for example, that 
of putting together parts of the machine). It would be both impractical 
and ineffective to present simultaneously to the student repeated visual 
instructions in a prograrr;.mcd workbook. He would be forced to shift 
his visual attention unceasingly back and forth betwen the page of the 
book and his work. In a situation of this kind it is natural that the pro- 
grammed instructions arc given auditively through a recorder, possib- 
ly with appliances which could prevent disturbance of others (earphones), 
but which still do not interfere with the mobility of the student (wire- 
less transmission). 

For the teaching of many kinds of skills, "simulators" of quite a 
complicated type are used (perhaps best known in pilat and driver 
training). Ordinarily these provide a versatile imitation of natural si- 
tuations, including also representative stimuli as well as the usual reac- 
tion possibilities (with the exception of some of the expense and the 
danger of the real situation). The student is trained, when he 
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receives CGrrtaixi-atirnuli (c* g. pictnixe of. .moment of dangcr'on- 
the road), to react in a certain manner (e. g. with special maneuvers 
with levers)* Usually teaching- in simulators is carried out by individual 
instructors. It should in many cases be possible, however, to rationa- 
lize the procedure by successive machine-presented instructions. If, 
moreover, the mechanically-offered stimuli sequence is built accord- 
ing to plan from a simpler to a more complicated course, and with 
some degree ^ adaptation to the student's speed of progress, we have 
a typical ex ■ le of a programmed teaching situation in which the me- 
chanical components play a natural role. 

In all of the examples now given, the introduction of the mechani- 
cal factors depends upon the presence of essential stimuli and/or essen- 
tial types of response in the terminal situation, which cannot be trans- 
lated naturally or with maximum effectivity into written-verbal or sta- 
tic picture symbols alone. There is a tendency to forget that terminal 
situations of this type play an important part in ordinary school teach- 
ing (e. g. in teaching languages) and that it is most significant in many 
adult education programs (in industry, for example). Once attention 
has been directed to the existence of these special situations, however, 
it is usually quite clear that mechanical arrangements often are of ba- 
sic importance here. 

Using the machine to discourage ’’cheating" is another story. Many 
of the machines presented during the early sixties had that more or less 
as their only purpose. TThe usual technique here is, as we know, that 
the machine presents one task at a time (via a "task-window", for 
example). When the student has answered it (possibly by writing in an 
answer blank), he draws forth, by some means, a key answer so that 
he can compare his answer with the "pattern answer". On many types of 
machines it is impossible for the student to change his own answer 
afterwards or to see the key answer before. The feeding mechanism 
of the machine moves in one direction only, and the student's own 
answer glides in under a transparent cover as soon as the model answer 
is turned forward. 

Are these special anti -c heating functions sufficient reason for 
acquiring these simple, but often fairly expensive machines? Is it not 
a mistake to introduce the thought of cheating during the learning process? 
(When it is not a question of a final examination, a look at the key answer 
can sometimes be both sensible and practical, and above all, it is both 
sensible and practical to be able to look over material which has already 
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been done. ) Is it not simply a case or provoking a less desirable atti- 
tude to the work if this is always presented in ’’cheat-proof^’ form 
(which might in some cases lead to an attempt to ’’fool" the machine)? 
These questions are meant to be thought-provoking; it is difficult to 
give them a definite answer valid for all kinds of situation. 

It might be well to point out, however, that the role of the machine 
in this connection cannot always be completely covered by the possibly 
somewhat misleading term ”anti-chcater". Actually that term ordinari- 
ly covers three different functions: (a) The student is prevented from 
seeing the key answer before he tries to reply himself. (This is, of 
course, the most typical of the ’’anti -cheating” functions. ) (b) The 
machine guarantees that the carefully planned work sequence is followed 
by the student, who does not have the opportunity of taking any undesir- 
able short cuts or zigzagging through the material (this could be called 
the ” s equenc e -guarantee” of the machine), (c) The machine limits the 
number of distracting stimuli and facilitates, thereby, the focusing of 
attention on the focal stimuli in each stage - unlike, for example, the 
welter of intertwining items of information to be found on one page of 
an ordinary book (this could be called the ’’focusing” function of the 
machine). 

It is easy to speak disparagingly of ”pag e -turning” machines, but 
it is not impossible that these three simple functions in certain cases 
can have a not insignificant influence on furthering cffectivity. At the 
beginning of this century - long before teaching machines in the modern 
sense had even been thought of - Thorndike, one of the leading figures 
in the study of the psychology of learning, mentioned how advantageous 
it would be for learning if textbooks could be so constructed that they 
did not allow the reader to proceed to page 2 before he had completed 
all that he was supposed to do on page i (Thorndike, 1912). Obviously 
it is just something of that uncompromising stage-by-stage presentation 
and stage-by-stage control which the program tries to achieve and which 
the simple machines, moreoever, try to guarantee. 

LiCt us consider a typical correspondence course taken by a student 
during the vacation period. The course offers informative material and 
a long list of practice problems in a ’’letter” which the student is 
supposed to read through before answering the test items. A conscien- 
tious student reads the letter carefully and solves the problems scrupu- 
lously in the prescribed order. A less conscientious student does not 
read so carefully, skips some of the problems which seem to be difficult, 
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or takes a peek at the key in order to get through them as soon as 
possible, A capable student feels, perhaps, that he can take consider- 
able short cuts, and sometimes goes directly from the information in 
the letter to the final as sigiiments. In some cases, naturally, this skip- 
ping technique on the part of the student can do no harm, especially 
since current correspondence courses are not often designed for the 
individual and therefore can contain entirely unnecessary repetition ma- 
terial for certain groups of students. But in many cases, this "short- 
cut behavior" (whether it derives from a desire to get through as quick- 
ly as possible or quite simply from the student^ s overrating of his own 
knowledge and ability) leads to a less satisfactory end result. 

Some form of "sequence guarantee" should logically reduce to 
some extent the danger of a deterioration in final results. And if such 
a sequence guarantee can be desirable even in an ordinary textbook or 
a correspondence course, it is reasonable to suppose that a guarantee 
would be of even greater importance in a programmed course where 
the order of assignments and number of assignments are the result of 
careful preliminary planning and testing, and where, therefore, "skip- 
ping behavior" is more seldom motivated. - There is obviously good 
reason for further testing of programs both with and without various 
simple " s equ ence -gua rantc cing" devices. We can only hope that later 
on we will be able to make a more definite statement about the value of 
these two modes of procedure. So far, much empirical research seems 
to have ended up by not being able to demonstrate significant differences 
between machine and text versions. (The "anti -cheating" component is - 
of what one thinks of its importance for instructional effec- 
tivity - of special value in connection with research, sii.ee it facilitates 
interpretation of the student's running performance; the student cannot, 
for example, complicate the work protocol with later changes. ) 

If we sum up what has iust been discussed and add to this some 
other points of view often expressed, we have the following list of com- 
mon arguments for mechanical set-ups: 

When the instruction material, in order to achieve full effectivi- 
ty, must contain stimuli of another type than the printed word and the 
static picture (for example, moving pictures or auditive stimuli), then 
mechanical components arc usually needed. A special case, which we 
will deal with in more detail below, is when we need to amplify or modi- 
fy the observation area. 
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2. When the instruction situation, in order to achieve full effectivi- 
ty, must give the student other reaction possibilities than those offered 
by pen and paper (such as is the case when training many manual-motor 
skills), the mechanical components are usually equally necessary. (This 
can sometimes mean construction of special teaching apparatus such as 
SAKI, while in other cases it may mean only the use of a programmed 
workbook in combination with an ordinary working machine. ) 

3. The instruction material in a typical auto -instructional course 
is designed to be presented step-by-stop, unit-by-unit, in a sequence 
carefully planned and fixed in advance, with the key solutions immediate- 
ly following the student^s own response attempt. The machine can be a 
guarantee that this planned, step-by-step and well -focused presentation 
can be realized, so that the student does not take forbidden short-cuts, 
skip tasks or look at the key answers before he has written down his 
answer. 

4. When more complicated systems of individualization are desired, 
a mechanical presentation can sometimes simplify the alterations needed 
within the total bank of instructional units and thus save time. 

5. When it is desirable to obtain " reaction summations '* quickly as 
an indication of the student achievements, mechanical devices for the 
registration of correct and incorrect answers can save a certain amount 
of work. 

6. In some cases machines probably increase motivation among cer- 
tain students for whom the physical manipulation and the gambling -type 
set-up may create an atmosphere of fun and play. 

When it is a question a choice between the tutomat arrangement and 
the t utoprint arranigeme nt , arguments 1-3 should be the decisive ones, 
while arguments 4-6 are usually of secondary importance. If a detailed 
student-adaptation is desired (argument 4), mechanical aids are some- 
times desirable and can - as a number of experiments have demonstrat- 
ed - be brought about by systems including a computer. For reasons of 
economy, among others, these arrangements so far have mostly occurred 
in research situations. In this case, however, it is reasonable to expect 
innovations and quick changes (cf. Box 8. 1). 
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Box 8, 1 Some notes on computer-assisted instruction 



A computer may sometimes be given the role of a teaching machine. 
We then talk about computer -as sisted or computer -directed instruc- 
tion. In some general discussions the two concepts of "programmed 
instruction" and "computer assisted instruction" have sometimes 
wrongly been considered to be in opposition to each other or to deal 
with widely different strategics. Often it would be more correct to 
consider computer-assisted instruction as a special case of program- 
med instruction: a case where one for one reason or an other has 
found it convenient to have the computer take over information stor- 
age, answer comparisons, and feedback to the student. The computer 
is better than more conventional teaching machines mainly in two re- 
spects: (a) It can store large data collections and thus hold both de- 
tailed student profiles and several different courses at the same time, 
(b) It can handle a great number of analyses and "decisions" more 
easily and more quickly than other arrangements. 

Let us take a look at the "conversation" between computer and 
student during a logic game in which the task of the student is to iden- 
tify a letter the computer is "thinking of", using as few questions as 
possible. The student is allowed only to put one question at the time, 
and the questions may deal with the number of curves, loose ends, 
obliques etc. (For instance, the letter X has no curves, but four 
loose ends, whereas R has one curve and two loose ends. ) This is 
how a conversation may proceed: 

Computer: Start 
Student: Curves ? 

C: One. 

S: Loose end s ? 

C: Two. 

S: Obliques? 

C: Zero. 

S: C. (Meaning C is the correct answer. ) 

C: You don^t have enough information yet to get the right answer. 

How do you know it isn^t J, for example? 

(Note: The computer will not accept a guess from the student, if he 
does not have enough information to back up a final decision; this is 
not a guessing game, but a logic game. ) 

S: J. ^ 

C: You don^t have enough information yet. How do you know it isn t C, 
for example? 
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Box 8, 1 (continued) 



S: Horizontals? 

C: Zero. That was a wasted question. It did not eliminate any possi- 
bilities. 

S: Verticals? 

C; Zero. Good question. 

S: a 

C: Wrong. Your guess is not consistent with the information you have 
been given. You must have forgotten that the right letter hasn't any 
horizontal lines. The letter you guessed can't be right - it has too 
many loose ends. 

S: Curves ? 

C: The answer is still: one. 

S: C. 

C: Yes, you have done it- Good work- If you want to play again, start 
right in. 

The example shows how the storage capacity and ability for quick 
analysis of the computer C 2 in be utilized to demonstrate to the student 
when he is asking an unnecessary question or comes up with c con- 
clusion not consistent with information given. This high degree of in- 
dividualization is quickly felt by the student to be both effective and 
exciting. 

In principle the instruction of the computer follows this design: 




The difficulties involved here are most often neither technical, nor 
economical, but educational -methodological. Technical solutions are 
available, and the costs need not necessarily be forbidding (if many 
students can utilize the equipment; also it seems reasonable to predict 
diminishing costs in the future as a consequence of the development of 
electronics). But the construction of the highly individualized program 
involves difficulties of a kind that teachers and education experts so 
far have only to a very limited extent dealt with systematically. 
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Box 8. 1 (continued) 



It is not at all self-evident what kinds of feedback are educationally 
most fruitful for various combinations of student characteristics and 
student reaction. Today, therefore, the problem is not so much 
what the computer is able to do, but to what extent we as behavioral 
scientists have sufficient knowledge of complex human learning to 
compose effective instructions for the computer, 

(The example above of logic games is based on Swets & Feurweg, 
1965. ) 
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8, 3 VARIOUS MECHANICAL ARRANGEMENTS 



Whon there is a question of choice between different types of tutomat 
arrangements , a number of other factors must be taken into con- 
sideration, In several cases (especially where special manual skills are 
concerned) a ’’ special tutoma t*' must be constructed for that particular 
purpose. Pask^s ”SAKI” for card -punching is an example of this. Simu- 
lator-arrangements with programmed instructions provide other examples. 
In many cases, however, a more generally applicable arrangement can 
be considered. Most of the so-called teaching machines on the market 
seem to be ’’ general tutomats ” in this sense of the word, and are chief- 
ly suitable for advancing verbally communicable knowledge and skills. 

Examples of the factors to be taken into consideration in choosing 
among the machines for more general use now on the market are pre- 
sented below. (Points 1 -4 deal chiefly with the stimulus phase, points 
5-7 with the reaction phase, and points 8-10 with certain forms for inter- 
play of reactions and stimuli. Points 11-12, finally, contain some prac- 
tical-economic considerations). 

I# Is visual presentation sufficient (as many of the constructors of 
apparatus seem to assume) or is auditive presentation also necessary? 
Auditive presentation is obviously of importance if the terminal behavior 
demands auditive discrimination, or if the focusing of the behavior is 
substantially facilitated by auditivcly communicated instructions (compare 
our example above); this is also quite obviously true in the case of stu- 
dents who can neither read nor write, 

Auidtive presentation is technically not especially difficult to arrange 
and occurs in many tutomat systems. But since it often involves a sub- 
stantial increase in the cost of materials, it should not be used unless 
necessary. In certain cases (ex. in the versatilely useful ”MTA Scholar") 
the auditive unit is. separate so that visual presentation only can be used 
at first, and the auditive unit brought into use later on if the need for it 
becomes apparent. 

2, Is it most advantageous in the teaching situation under considera- 
tion to choose the printed page or projected still pictures as a means of 
presenting information? Those apparatus which use printed sheets are 
often cheaper. Moreoever, the printed sheet is, as a rule, easier to 
produce within the frame of existing resources, for example in a school 
(where ordinarily you are more likely to have access to a stencil appara- 
tus than to a developing laboratory). On the other hand, a supply of paper 
programs often demands a great deal of storage space. In addition, paper 
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programs, if they are to contain illustrations (especially color photos), 
can be considerably more expensive than programs on microfilm. If the 
projection apparatus is chosen, care must be taken that the projected 
]Dictures do not create special '^tiring” effects. 

2. Is ** focusing ’^ on one task at a tine essential to the program? 

4. Is it desirable to be able to try out stenciled versions of new pro- 
grams directly without encountering problems with paper format or type 
of paper ? If so, machines using odd sizes of paper are less suitable, 
as well as apparatus which work with different types of running paper, 
lengths (folded fanwise or rolled). 

5. Is it essential to have s elf -constructed answers (with reference 
to the special terminal behavior which one hopes to achieve), or is it 
sufficient (perhaps even more natural) to work with choice reactions ? 
Machines which work with written student answers are best suited to 

the former, whereas most machines which work with keyboard responses 
are better for the latter. It should be noted, however, that certain key- 
board machines can be used for self -constructed answerj (using combi- 
nations of letters or of numerals). 

6. Is it desirable that the student be able to work on a special ’’answer 
strip ” to make possible repeated use of the same program sheet? If so, 
apparatus without separate answer arrangements are not suitable. Is 

it desirable to be able to use the machine both with and without a special 
answer strip? (In research one may want the answers included in the 
program, while for practical use it is perhaps desirable to save paper. ) 
If this is the case, then apparatus with both possibilities are worth con- 
sidering. 

7. If some form of error summation is desired, it is usually ne- 
cessary to use some kind of key-board apparatus (these often have error 
computers, e. g. **Auto-Tutor Mark IF'). There are also machines with 
written answer s and some "semi-automatic" error -counting operated 
by the student. In the latter case, however, one must be sure that the 
student does not "forget", either wittingly or unwittingly, to mark all 
errors. 

8. Is it enough to work with linear progression, that is, the same 
system of instructional units for all students, or is it desirable to have 
possibilities for " branching " within the unit sequence? Most tutomats 
are designed for linear progression. There are a few, however, which 
offer good branching possibilites; among the best-known cf these is 
"Auto-Tutor Mark II". (The principal questions in regard to various 
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branching -off procedures will be discussed below. ) 

9. Is there a need for a mechanical ** skimming*' -device as a time- 
saver in later repetition? Very few apparatus have any such possibili- 
ty. In principle, an arrangement of this type can be built into a tape 
recorder unit. The student thereby enters a high f r e quency tone on the 
tape every time he makes a mistake. When the tape is run back quick- 
ly afterwards, it slows down to normal speed just at those points. 

10. Is there any need for a mechanical pac e -accelerator ? It is usu- 
ally considered one of the advantages of programmed instruction that 
the student may set his own y ace. In certain cases, however, success! - 
vely increased demands - still fitted to the individual - can be even 
more advantageous, since *-hey may force faster performance. The Pask- 
machine "SAKI" described above suggests how an arrangement of this 
type can be worked out. Ordinarily these arrangements are expensive, 
however, and it is not at all certain that their instructional value is in 
proportion to the cost. 

11. Which is more important, low cost or durability? Many varia- 
tions are available, from the cheap and disposable paper devices to ex- 
pensive and fairly durable metal constructions. Unfortunately, many of 
the existing apparatus ar both expensive and easily damaged. 

12. Which is more important, capacity for program storage or 
space saving (and possibilities for stacking)? The well-known problem 
of the good lady^s shoe - it must be large inside and small outside - 
has turned up again in a new version. The supply of machines for one 
class should not take up too much space. On the other hand, they should 
not hold so little continuous material that they must constantly be 
opened (by the teacher, for instance) in order to change the material. 
Naturally, the storage capacity in principle is greatest in those appara- 
tus which use micro-material for projection. Because of the space 
needed for the projector itself and the power supply, however, these 
apparatus can seldom be listed among those most easily handled. 
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8. 4 AMPLIFYING AND MODIFYING THE OBSERVATION AREA: 

SOME NOTES ON CCTV AND VIDEO-RECORDING IN INSTRUC - 
TIONAL SYSTEMS 

Among the training situations for which some sort of mechanical arrange- 
ment seems indicated, we mentioned above the special case where there 
is a need to amplify and/or modify the ’'observation area”. Good 
techniques for doing this arc now available in the form of clos cd -circuit 
television systems and vide -recording. Since such systems are now 
inc reasingly being used as major components of instructional systems, 
it seems pertinent to make a brief digression here from our main theme 
with some notes on these aids. We shall focus on some general prin- 
ciples, illustrating various way of amplifying and modifying the obser- 
vation area, but we shall also try to make our comments concrete by 
relating to a particular area of application. 




8. 4. 1 General Character of CCTV and Video -Recording 

Before we try to answer our main question here, namely how closed- 
circuit television can be used to amj^lify and modify the observation 
area in a way that will be helpful to instruction, it would perhaps be as 
well to recapitulate briefly some main characteristics of these aids. 

’’Closed -circuit television”(CCTV) commonly means the transmission 
of sound and pictures to receivers within a closed system, e. g. by 
means of cables (as opposed to the open "broadcast television"). Thus 
a CCTV system is usually clearly defined in its scope, which does not, 
however, nece s sar ily mean that it is small. It can be a very small 
class-room system (where camera and receiver are both in the same 
room for demonstration purposes, sometimes called "desk TV"), but 
it can also be a system which embraces a very wide geographical area. 

A minimum installation for transmission from one room to another 
has these characteristics; For picture transmission there is a TV 
camera in the sending area which is connected to a TV receiver in the 
viewing area and for sound transmission a microphone and loudspeaker 
respectively. 

There is, however, comparatively limited use for such a simple 
system. Instead, one usually considers a larger installation of the gene- 
ral type outlined in Figure 8. 3. (It should be emphasized that the figure 
gives only a general sketch and not a complete technical diagram. ) In 
the sending area (S) - for instance, a classroom - there arc two or 
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three cameras, of which at least one can be worked by remote control, 
both optically and for direction, and a number of microphones, one of 
them perhaps a neck microphone for the teacher. Picture and sound im- 
pulses go first into the control room (C), where they can be both record- 
ed by means of the video-tape recorder and also transmitted further 
either completely or partly to one or more viewing areas (V^, etc. ). 

In the control room there is a picture receiver for each camera 
(monitor). In certain cases pictures from each camera are transmitted, 
so that there is one receiver for each picture in the viewing room. In 
other cases, the pictures arc selected in the control room, and only one 
picture is transmitted to the viewers, i. e. the one which seems most 
valuable at a given moment. If the viewing space is large, it can be 
equipped with a large number of receivers so that the viewers can form 
small groups for unhindered observation. But there is also the alter- 
native possibility of using a special projector which shows an enlarged 
picture. 

Within the framework of a system of this kind there arc many possi- 
bilities for variation. Tlic cameras can be fixed without operators, ope- 
rated manually within the sending area, or manipulated by remote 
control. The microphones can be fixed, worked by remote control, or 
portable. The portable ones can be wired to the control room or be of 
the wire-less type etc. 

The video-tape recorder included in our figure is not, of course, a 
necessary ingredient. However, as we shall see, video-tape recorders 
are a very valuable addition to the arsenal of aids whose further develop- 
ment should be followed cdth great interest by those engaged in the con- 
struction of training systems. 

8. 4, 2 CCTV and Video-Recording as ^^Observation Amplifiers* * 

Numerous advances in science, education and production arc the resu 
of many's success in constructing new aids which have increased his 
capacity to receive information or process it, or both. The microscope 
is an example of an aid which has increased man^s capacity to collect 
information, while a computer is a machine which has increased his abi- 
lity to process it. Without making general comparisons, it would be use- 
ful to regard CCTV and video-tape recording as ’’observation-amplifying'’ 
aids of potential value for education in general. Let us, however, for 
the purpose of illustration, focus upon a special area of application and 
ask ourselves: Which types of observation -amplifying arrangements. 
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using these aids, are most adequate for use in teache training: Fi- 
gure 8, 4 gives some main examples, which I will here briefly explain 
and comment on. 

By *’mic ro - showing*' (Figure 8. 4, a) we mean here the possibility of 
demonstrating small objects and events to a large group of observers 
simultaneously. This is perhaps one of the most frequent uses of tele- 
vision in education, e. g, in medicine. A dental or heart operation can 
be followed in detail by a large group of dental or medical students via 
the TV screen. A demonstration which would otherwise be limited to 
a very small group of direct observers can now be observed by a very 
large group. This means that the events which the individual student 
would perhaps never have the opportunity of seeing because of their 
comparatively low frequency in the training or practice institution in 
question can be illustrated concretely in the course of teaching. 

Several of the difficulties experienced in teacher training could 
well be minimized if wider use were made of the mic ro -schowing qua- 
lities of CCTV and video-tape recording. The possibility of giving a 
concrete demonstration of events within the framework of theory teach- 
ing is considerably increased, which should contribute to narrowing the 
gap between the worlds of theory and practice. Similarly the possibili- 
ty of the student teacher^s seeing and hearing details during the course 
^f an observation lesson is also increased. The possibility of spreading 
information about infrequent phenomena to large groups is obvious. 

For this purpose we can use very simple arrangements of the "desk TV" 
type, by which a theory lecturer can demonstrate an individual child/s 
work with s elf -instructional material or with a test (in this case the 
child is present in the lecture room). But it can also be used for de- 
monstrations of test and study material from a studio or classroom 
(where, for example, a child and a tester or a child and teacher can 
work undisturbed by the presence of an observation group) or for the 
showing of a previously recorded demonstration. In this way the me- 
thods used in a laterality test, individual pronunciation training or in 
working with small groups can advantageously be demonstrated. Final- 
ly, it could be used for something more ixke the normal observation 
lesson, where the student teachers can follow a whole class at work, 
while a manually or remote control operated camera can take close- 
ups of interesting details in the course of the teaching. 

"Macro-showing" (Figure 8.4, b) means that an observer can watch 
several separa te observation areas. Signals from different sending 
areas are led into a common viewing area (with several TV receivers). 
We find this method used in supervision of traffic areas, prisons and 
factories; a single supervisor can by this means keep his eye on a 
large area without leaving his post. A comparable method can be used 
in teacher training for simultaneous or almost simultaneous observa- 
tion of several different classes in which, for example, the same step 
in a given subjicct is being handled in different ways. Here it is not 
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usually the case that one observer sees many observation objects, but 
instead that a group of observers, gathered in one place for tutorial 
discussion before and after the observation, c .n see picture material 
from two or more classrooms at the same time. Sound signals from 
the different classrooms can be switched on alternately to avoid distur- 
bing the observer too much (alternating rather than completely simul- 
taneous observation). Such observations should in many cases give a 
good background for evaluative and comparative discussion. 

^’Shielded showing" (Figure 8.4, c) means that the viewer and the 
object are shielded from each other. One of the most obvious examples 
of this type of use is in atomic laboratories. Processes which would be 
highly dangerous for an observer to study in situ because of radioactive 
radiation can be studied at a suitable distance or behind protective lead 
walls. Only the TV camera is in the actual location. In teacher training 
it is not of course necessary to protect the observer from the observed 
object. On the other hand, there is an obvious need to protect those 
observed (the children and their teacher) from disturbance by the ob- 
serving group. It is true that classes under observation do become re - 
latively easily accustomed by experience to having a small group of 
observers in a corner of the classroom. But - and this is a particular- 
ly important reservation - oral commentaries (by e. g. a teacher of 
method or education) during the course of the observation arc out of the 
question. Furthermore, an observation group inside a classroom must 
always be small, whereas a group of observers can be of almost any 
size if shielded viewing is used. These two factors combined (the possi- 
bility of simultaneous commentary and of increasing the size of the 
group of observers) obviously mean a considerable improvement in the 
observation situation and can theoretically help to avoid several of the 
many difficulties in observing lessons. It will be possible to make the 
observation more meaningful by carefully directing the observers^ atten- 
tion during the observation. All will obtain the same background of 
experience, which will also make it possible for the teacher of theory 
to give more detailed and adequate comments afterwards. A large group 
of student teachers can more easily be given the opportunity of observ- 
ing even the less frequent phenomena. Administrative and schedule - 
making difficulties are reduced and teacher students waste less time in 
travelling. 

Another method of facilitating observation by student teachers is to 
direct their attention by means of a selection of pictures to what the lec- 
turer in education or method considers most interesting at a particular 

95 



- 8 . 21 - 



moment (^’focused showing": Figure 8„4, d). Technically, this works 
mainly in two ways: a roving camera is directed at the desired point 
of interest at the given moment, or a choice can be made in the control 
room between several incoming pictures (which arc continually being 
studied in the monitors) of what is most profitable to distribute to the 
viewing room. This procedure has the instructional and psychological 
advantage that the confusing mass of possibilities for observation arc 
cut down, what is considered important is brought to the foreground, 
and the *^e?t which from the point of view of informational psychology 
can at that moment be considered as irrelevant "noise”, is cut out. If 
the choice is made skilfully (and this naturally makes great demands 
on the person selecting the pictures), this kind of technical device 
might considerably increase the educational effect of the observation 
period. 

With the aid of the video-recorder, this spatial selection can be 
supplemented by selection in time. "Concentrated showing" (Figure 
8,4, c) means that the raw material is cut and only certain essential 
points are shown. There are plenty of examples of this type of "re- 
duced" sending in the conventional TV programs on sports or parlia- 
mentary discussions. Every football kick and every word said by a 
member of Congress are certainly not pearls, and skilful selection 
saves a great deal of time vhile still giving sufficicint information. The 
same thing can be done with classroom observation material. Student 
teachers sometimes experience an observation period as somewhat un- 
productive "sitting-in" partly because they are unaccustomed to obser- 
vation and it is not possible to direct their attention, but partly also 
because a certain amount of what happens is naturally comparatively 
uninteresting, at least as far as the specific point being studied is con- 
cerned. A solution to this problem can be obtained by means of the 
video-tape recorder. Technically this can be arranged either by making 
a partial recording or by making a selection later (e. g. by partial copy- 
ing from another tape). The latter method allows a. better planned se- 
lection to be made; the former, on the other hand,siaves time and tape. 
What we get is a rationalized demonstration situation in which, in 
addition, we are not bound by time and space. To take one of many 
examples, there is nothing to prevent our using the material for evening 
refresher courses for teachers. 

Once the observation material has been recorded on video-tape, 
there is moreover scarcely any limit to what can bc^'donc by editing. It 
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would often be an advantage to produce a demonstration tape in which 
short illustrations of procedures are shown for comparative analysis 
(different ways of beginning a lesson, different ways of handling a 
breach of discipline, different ways of concretising abstract concep- 
tions etc, etc, ). Such ’’ contrast -illustrating demonstration tapes *' 
should obviously provide excellent starting points for tutorial discussion 
on many topics. By inserting a preparatory and/or subsequent commen- 
tary by the lecturer in method or education, the illustration tape can 
be built up into independent teaching material which can also be used 
by a less experienced group leader (** commcntary-interf oliated de- 
monstration tape **)* An even more important possibility is perhaps 
that of inserting tasks for the observers. The possibility of stopping 
a lesson in mid-action to make it possible for the student teachers 
to consider and make their own decisions about a teacher^s possible 
behavior when faced with concrete classroom incidents and then see 
what the teacher actually did and what the results were has some- 
times been described as wishful thinking. But video-tape recording 
makes it possible to conjure with time in this way. Such activation of 
the observer could have several good effects: it compels him to pay 
close attention, to think more deeply and to take a more personal 
attitude. It can also be arranged so that misunderstandings are im- 
mediately corrected. Such tasks could therefore help to make the ob- 
servation more meaningful and lessen the gap between it and what the 
students would do themselves in practice, '* Taskinterf oliated de- 
monstration tapes" will in this way be very similar to other self- 
in structional material and also to the "classroom simulators" which 
have sometimes been used (usually with the aid of filmed material). 

They could be used not only for training in adequate decisions and 
teacher-behavior , but also as a test of the student teacher^s repertoire 
of behavioral tendencies relevant to the classroom role. They could 
also perhaps pave the way for better methods of selection and better 
aids to grading than those we now have. 

Finally, "mirror -showing** or ** s elf -confrontation** (Figure 8,4, f) 
means that a person can study himself and his own behavior patterns 
by means of vide -tape recording. This method has been used for 
example in athletics teaching, where high-jump or stroke techniques 
are studied by the athletes themselves afterwards. A similar technique 
can be used in teacher training*, to observe one^s own lessons would 
become, with the aid cf the video-tape, not something supernatural, 
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but a highly practical aid in our attempts to make the student teacher 
aware of his shortcomings and merits. 

So far we have mainly considered different ways of using closed- 
circuit television and video-tape recording in order to make students^ 
lesson observation and teaching practice more effective. Obviously 
the advontages of these two aids as ” observation amplifiers" can 
also be used in other ways in teacher training. In a situation where 
there is a lack of teachers of educational theory, CCTV can thus be 
used for " multiple direct teaching " (lectures and demonstrations 
are simultaneously transmitted to several different lecture rooms, 
perhaps even from one School of Education to branches in other pla- 
ces), Lectures in education and method who are going to give 
lectures, demonstrations etc. on public television can, with the aid 
of the video-tape recorder, give themselves teaching practice ("re- 
hearsal with play -back"). The technique of judging lessons could 
well be practised by means of group evaluation of recorded material 
followed by discussions. The reliability of teaching marks could 
also possibly be increased by using a technique v/hereby a number 
of independent assessors judge the same lesson (which should not 
be administratively impossible with the help of recorded material: 
"objectivis ed behavior assessment"). There is not room here to go 
more deeply into the advantages and disadvantages of these different 
possibilities. They should however be borne in mind for further 
research work. 

Among the often mentioned difficulties in teacher training, we may 
note our lack of basic knowledge as far as teaching methods are con- 
cerned, and the fact that these problems are connected with insuffi- 
cient research and the earlier difficulties in recording objectively 
actual events in the classroom. There is no doubt that here too CCTV 
and video-recording have opened up new possibilities which should 
gradually contribute to more definite basic knowledge. The advantages 
of video-recording as a " data -storage research aid " should not be 
forgotten in this connection. 
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Figure 8, 3 Typical installation of CCTV 



In the sending area (S) there are three TV cameras, one of which can 
be directed by remote control, three fixed microphones and one 
portable teacher's microphone. 



In the control room (C) there are monitors, picture selectors and a 
video-tape recorder etc* In a large viewing area (V^) there are, in 
addition to loudspeakers, either a number of TV receivers (four in 
.the picture) or an enlarging projector. Viewing can take place 
simultaneously in separate rooms (e.g. A tutor/ supervisor in 

the viewing room can communicate with the control room via a 
^ ••Portable microphone. 
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a)' *' Micro«» showing ^* 




ObJ. 



b) ** Macro -showing " 




c) ** Shielded showing " 




d) ^^ Focuscd showing ** 

(spatial selection) 




I Objj 



\ 

A 



e) " Concentrated showing " 

(time selection) 





Figure 8, 4 Schematic examples of different types of "observation 

amplifying" arrangements possible with CCTV and video-tape 
recording. 




Symbols: 



Oj, 0^, Oj etc. 
Objj, Obj^ etc 
tj* etc. 
oti» ot^ etc. 



=? observers 

=: objects for observation 
time 1, 2 etc^ in a sequence of events 
= time 1, 2 etc. in a sequence of observations 
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8. 5 VARIOUS NON-MECHANICAL ARRANGEMENTS 

•After this excursion, dealing with an important but rather special aid 
in instructional system building, let us return to the question of mecha- 
nical vs. nonmechanical arrangements. Since tutomat arrangements 
are often comparatively expensive and since many of them, in spite 
of the fact that they are meant for general use, have their special limi- 
tations, it is a good idea in many instances to begin with an attempt to 
manage without a tutomafc system. Only when experience has shown 
that mechanical components really are desirable, is it advisable to 
buy one or to have one constructed. (This general recommendation 
does not apply, naturally, in those cases discussed earlier, where 
the character of the terminal situation shows immediately that some 
sort of tutomat arrangement is necessary. ) 

It can be reported parenthetically that about two-thirds of all U, S. 
programs commercially avialable in the year 1965 had been produced 
only in a tutoprint version. The relative number of programs wich 
were produced both for mechanical and non-mechanical use dropped 
noticeably from the year 1962 to 1965 (see Table 8, 1). 

Table 8. 1 Mode of presentation in U. S, programs: Three surveys 



For non - mechanical For mechanical For both 
use only use only methods 



Programs, 1962 31 % 7% 62% 

Programs, 1963 56 % 20% 24% 

Programs, 1965 66 % 21 % 12 % 

(Percentage figures are based on information in "Programmed in- 
struction materials 1964-65, covering 102 programs in 1962, 333 
programs in 1963, and 291 programs in 1964-65.) 



In this respect, however, there are interesting international differen-r 
ces. In Britain we find a predominance of machine programs (see 
Table 8. 2). In 1966, more than four out of five of the American programs 
available in Britain were in book form, while just over one in five of 
the British-made programs was designed as a book. 

Table 8. 2 Mode of presentation: Programs available on the British 
market (Total figures, 1960-66) 





B ritish 


American 


Text 


156 (20, 8 %) 


410 (87,4 %) 


Machine 


593 (79, 2 %) 


59 (12,6 %) 


Total 


749 


469 



Later on a decrease is seen in British machine program figures. Never- 
theless, in the 1969 survey (Cavanagh & Jones, 1969) they still repre- 
sent the majority of British programs (107^ out of 1553, or 60 %), 
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If we want to try out a simple tutoprint arrangement to begin with, 
what are the possibilities? Among the most common methods of pro- 
cedure are the ’’panel-books" (in which the presentation units consist 
of shorter parts, pantjls, on one page and where these units are 
arranged in some form of succession) and ’’^crarrbled book" (in which 
the presentation units ordinarily consist of entire pages, and where 
these units are arranged in a more ’ scrambled’’ fasho*'). Panel-books 
can also appear in different forms (among others, different "reading 
directions"). Here are some examples of different tutoprint arrange- 
ments at the present time: 

(a) Panel-book with vertical progression ("The vertical panel - book"). 
This arrangement differs least from an ordinary textbook. The pages 
are read as usual from top to bottom and in the usual order. That 
which in appearance distinguishes this type of book from conventional 
books is chiefly the more widely spaced printing. Every instructional 
unit is usually demarcated from the others with heavy horizontal lines. 
The student writes his ansv/er as a rule within the frame of the instruc- 
tional unit, often on an empty line which leaves blank one or more key 
words from the text. The model answer appears relatively near the 
response request, perhaps in a special column in the margin either 
right beside the response request or - in order not to be too con- 
spicuous - beside the following unit (see Figure 8. 5). 

The method of procedure is quite a common one (see, for example, 
an early and well-known introduction to programming techniques: 

Markle et al. , I 961 ). The printing and editing techniques are simple. 

The greatest drawback is actually that the temptation to look at the 
key answer immediately is so great. But with certain types of students 
and certain kinds of assignments, this is undoubtedly not of very great 
importance. 

Some studies have even shown faster work with the same degree of 
knowledge, when the students are specifically instructed to read the 
answer at once (instead of first writing down their own answer and then 
looking at the key answer). This method can undoubtedly function well 
in some situations, especially when the percentage of correct answers 
is high in any case and the model answer is, therefore, a relatively 
"unnecessary" confirmation of something which the student understands 
immediately. This should be an interesting field for further research, 
since it concerns one of the fundamental principles of programmed 
teaching. Some of the early programmers emphasized strongly the 
significance of the overt answering behavior and seemed even to have 
difficulty in acknowledging that learning can take place without this overt 
reaction. On the other hand, many interpret research experience in 
this area to mean that increase in effectiveness in programming is more 
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depeudcnt on the improved focusing of the stepwise presentation and 
the cognitive working over of these well -focused stimuli than with the 
observable response behavior in itself. The latter can be of value as 
a guarantee for the cognitive working over, but it need not be essen - 
tial to learning for that resson. 

(b) Panel-book with horizontal progression (*'the horizontal panel - 
book **). Here an attempt has been made to avoid the difficulties with 
the great ’’cheating temptation” discussed above by setting up the book 
horizontally. The pages appear much the same as those in the vertical 
panel -be ok with a row of clearly demarcated test items. The student 
does not read the book page by page, however. Instead he usually goes 
from the upper section of the first page to the upper section of the 
next page, etc. In other words, he reads a certain section of the pages 
throughout the whole book (or in any case through a part of the book) 
before he goes over to other sections of the same pages. 

The simplest arrangement would be, therefore, to let the first 
item on the first page have its key answer in the first section on the 
second page, after which t' e new item at the top of the third page 
would have its key answer in the fi-;st section on the fourth page. Chea- 
ting is still easy, it is true, since it is just a matter of turning the 
page, but the temptation is less than when the key answer information 
is placed right next to the test item. In order to avoid disturbing fac- 
tors from the answer to the preceding test item, it is probably better 
to allow the student to turn the page after every presentation unit. By 
this means the first test item on the first page has its key answer on 
the third page, after which the new test items on the fifth pag c have 
their key answers on the seventh page (compare Figure 8. 6, Type A), 

One constructional disadvantage of the horizontal panel -book is 
that editing is more complicated (the addition o: just one unit can 
involve rearranging large sections). One disadvantage in respect to 
teaching cffectivity is that the pupils might possibly have difficulty 
in ’’navigating” the transition from one page to the new page and can 
easily land on the wrong ’’track”. In some cases an attempt is made 
to prevent this by printing every other section in a contrasting style 
(for example, on a grey background). An economic drawback, finally, 
is that this method of procedure involves the consumption of a great 
deal of paper, since the key answer panel uses as much paper as the 
test item panel. In order to save paper, therefore, the second unit 
is often allowed to follow directly after the key answer to the first 
unit (within the same section and same page; compare Figure 8, 6, 

Type B). This has been done, for example, in one of the best-known, 
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’'classical'^ programmed textbooks, namely Holland Skinner: ’’The 
Analysis of Behavior*'. 

One difficulty with the last-mentioned method can be that focusing 
on the new items can be disturbed by the preceding answer. In theory 
it is naturally better to have response request 1 and key answer 1 
within the field of vision simultaneously (as often is the case with ma- 
chinepresentation), than to see key answer 1 and response request 2 
at the same time (which is more often than not the result of an effort 
to save paper in the horizontal panel -book). The latter ai rangement 
can be no small source of disturbance, especially when the aim is to 
teach a special type of response with varying stimuli and gradually 
fading prompting assistance in a certain task sequence. In some pro- 
grams at least it would undoubtedly be a case of injudicious zeal to 
use this paper-saving technique. 

(c) Panel-book with zigzag progression ("Zigzag Book"). One way 
of solving the problem - to have the response request and key answer 
in the same field of vision after the student answer without their also 
being in the same visual field before - would be to work with '*cut" 
sections which can be turned forward and backward independently. Then, 
for example, item 1 can be given in the first section of the first page, 
and key answer 1 be given in the second section of page three. While 

the task of the item is being solved, the key answer is concealed. 

When the problem is solved , the answer is made visible (by folding 
down the upper flap of panel 2), but the response request is still with- 
in the visual field. (See Figure 8. 7 and Figure 8. 8. ) 

(d) Panel-books with extra aids . The temptation to cheat can be 
diminished to some extent and, in any case, focusing increases with 
the vertical panel -book if some type of aid is used for covering the 
key answers while the test items are being solved. It can be a separate 
cover stick or one which glides along a groove in the cover, or per- 
haps a separate outer cover equipped with a series of side flaps which 
can successively be turned up. 

(e) The Scrambled Book * One of the best-known types of programmed 
textbooks is Crowder^s so-called *’scrarrjbled book*! In this version a 
whole page is used, as a rule, for each information unit with its re- 
sponse request. On one page appears first information and then a con- 
trol problem. The student then must choose between a number of 
alternative answers, after which he is referred to one of a number 
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of different pages, depending on which alternative he has chosen. If 
he has made the correct choice, the new page presents new informa- 
tion and the new unit. If his choice has been wrong, he finds an ex- 
planation of the mistake. In the latter case he is usually then referred 
back to the previous page with the recommendation that he choose a 
better answer alternative (ree Figure 8. 9). 

That arrangement is, therefore, especially adapted to individua- 
lization of content, and it also functions in discouraging the tempta- 
tion to cheat. (It is possible, of course, to peek at all the pages to 
which reference is made before beginning to think, but for most stu- 
dents it is more satisfactory - and often faster - to think first and 
turn pages later. ) One disadvantage can be, however, that in the usual 
format we are forced to present to the student completed answer al- 
ternatives, which under some circumstances is perhaps less desirable. 
Considering the terminal behavior at which we are aiming, the choice 
reactions may not be sufficient, and it is not always wise to present 
confusing misinformation in the earlier phases of the teaching process 
(a more detailed discussion of these problems will be presented in 
connection with an analysis of different "flow models"). 

(f) " Cheat-proof" tutoprint arrangement. None Oi. the tutoprint 
systems mentioned above is cheat-proof even if the degrees of temp- 
tation and opportunity may vary. Attempts have been made to devise 
more cheat-proof systems. These usually have the drawback that they 
deal with choice reactions (multiple choice answers). If this is 
acceptable with reference to the terminal behavior, then one of the 
following arrangements may be worth trying - surface co'^ ers, per- 
forations, embossed key answers, or chemically prepared answer 
sheets. 

The first technique means that the student selects one of the answer 
alternatives by erasing an opaque cover either directly after or under 
the alternative in question. Under this cover lie can find the informa- 
tion which tells him whether he has chosen correctly or not. At the 
same time the student has, naturally, no possibility of invalidating 
his selection. The second method - perforation -.can take a number 
of forms. In principle it means that the student answers by making a 
hole with his pencil in the answer sheet at the alternative he considers 
correct. Through this hole he gets, by one means or another (e. g. with 
different colors), a report as to whether he has answered correctly or 



105 



8 , 31 



incorrectly. The third method - the embossed answer technique - 
makes use of a response unit consisting of an answer sheet printed 
on the outside of an envelope which contains the answer plate with 
raised symbols as well as carbon paper. The student answers by 
rubbing the blunt end of the pencil over the selected answer pane, 
which makes visible the information on the accuracy of the answer 
(Figure 8, 10), The fourth - chemical - technique involvo-Q the use 
of a special pencil or paintbrush with which the student either touches 
or dampens an answer sheet, thus indicating which choice he thinks 
is the right one. The answer sheet is chemically treated in such a 
way that it turns a certain color (e, g. blue) if the answer is correct, 
and another color (e. g. red) if the answer is wrong. 

To sum up, among the questions which should be considered be- 
fore selecting a tutoprint arrangement are the following: Is a linear 
or a branched unit sequence desired? Is a self -devised answer essen- 
tial for the terminal behavior, or are choice reactions sufficient (or 
even rr .^re natural)? How much weight should be placed in our special 
student groups on possibilities for cheating and the temptation to 
cheat? How important is it to be able to have the response request 
and the key answer simultaneously in the visual field after the student 
response? How important is it in our special programs not to have 
distracting elements from previous iten s in the visual field while a 
new problem is being solved? If the answers to these questions are 
unequivocal, then the selection of an arrangement for the special pur- 
poses can be relatively simple. But it is also possible that none of the 
existing systems is entirely satisfactory. Efficient arrangements 
which work with selfcreated answers and at the same time have low 
risk for cheating, or none at all, do not seem to be available at the 
present time. Neither are a number of the compromises between good 
focusing and economizing on paper especially successful. In these 
areas new and better ideas arc needed. 
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Type A: 



Task 1 Answer i 



Task 2 Answer 2 



Task 3 Answer 3 



Task 4 Answer 4 



Type B: 



Task 1 j 


Answer 


1 


Task 2 


Answer 


2 


Task 3 


Ans wer 


3 


Task 4 



Figure 8, 5 "The Vertical Panel-Book" 
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Answer 


1 




Answer 


101 




Answer 


201 




Answer 


301 




Page 3 


An swer 


1 


Task 2 


Answer 


101 


Task 102 


Answer 


201 


Task 202 


Answer 


301 


Task 302 




Page 5 



Answer 2 


Task 3 


Answer 102 


Task 103 


Answer 202 


Task 203 


Answer 302 


Task 303 



P^igure 8, 6 "The Horizontal Panel-book" 

Note: Even-numbered pages need not be left blank, but can as a 
rule be used for new tasks and answers, for example, as follows 
(for Type A); page 2 upper: Task 51; page 4 upper: Answer 51, etc. 
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Pajve 1 Page 3 

(Student^s arrangement 
while solving Task 1) 



Task 1 








Answer 1 


Task 100 








Answer 100 



Pages 1 and 3 

(Student's arrangement 
after solution of Task 




Figure 8. 7 »‘Zigzag Book*' 
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1 

j Tyjje of arrangement 


‘V/ithin the visual field* 


At stage A 
(ex. , solving 
TaL.k 3) 


1 

i At stage B 

! (ex. , answer control 

! for Task 3) 


Vertical Panel-Book 


r 

T3 + K3 


^3 + ^3 


Horizontal Panel-Book, 
Type A 


only T 3 


only Kj 


Horizontal Panel-Book, 
Typo B 


+ T3 


K3+T4 


! Zigzag Book 
1 


only T^ 


T3 + ‘S 



Figure 8 , 8 Principle differences with reference to '‘focusing balance** 
between four typos of tutoprint arrangements for linear 
program. 

In the above chart the letter T is used to symbolize the given tasks 
(with or without student answer affixed), while the letter K represents 
the **koy answer*'. The stimuli arrangements which most likely are loss 
suitable (since they bring about inadequate focusing-balancc) are in 
italics. The vortical panel -books provide too little screening in the 
first v/orlc stage, while the horizontal panoKbook Typo A provides too 
strong screening in the second stage. The horizontal panel -book Type B 
gives too little screening in the first stage (when Task 3 is solved, the 
answer to Task 2 may furnish an inadvortant prompt) and an inadequate 
shielding in the second stage (too great, inasmuch as Task 3 should 
still be accessible; too little, inasmuch as Task 4 is not relevant to 
observation of key to Task 3). Of the Ipur arrangements shown here, 
only the **Zigzag Book*' seems to fulf*' the demands of focusing balance. 



109 



- 8. 35 - 



Page 1 

^ 

TKis is a scrambled bo^ i 

The pages are not to be ; 

read in the usual order. i 

Turn to page 3 and I 

read Task 1. j 



Page 3 

I Information 1 
j Task 1 

♦ Answer 1 a - See page 2 
i Answer lb- See page 5 
Answer i c - Sec page 11 



Page 5 

! You chose Answer 1 b. 
CORRECT! 

Information 2 
Task 2 

Answer 2 a - See page 4 
Answer 2b- See page 7 
Answer 2 c - See page 13 



Page 2 

I — — — — i 

1 You chose Answer 1 a 
j Too bad . . . 

Explanation of error 1 a 
Go back to page 3 and try again! 



Page 4 

j You chose Answer 2 a. 

• 

I Tough luck . . . 

j Explanation of error 2 a 

I Go back to page 5 and try again! 



Figure 8. 9 Scrambled Book 
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Figure 8. 10 Example of attempt to devise "cheat-proof" tuto- 
print arrangements (raised answer technique) 

Each work sequence is represented by an answer envelope printed 
somewhat like the above, an aiiswer plate with raised letters, 
numerals, etc. , as well as a carbon and a copy-paper. When the 
answer plate plus a carbon and a copy-sheet have been placed in 
the envelope, the squares printed on the front of the envelope match 
up to the syrnbols on the answer plate inside. If the student now 
rubs a certain square with a pencil, the symbols from the answer 
plate are visible in that square; at the same time they are also 
registered on the copy paper in the envelope. 

^ One way of using this arrangement is to work with a question 
list with choice of answers. The student marks on the sealed 
envelope the answers he thinks are correct. The symbols which 
then become visible let him know whether he is right or wrong. 

The symbols can, moreover, also provide page references (for 
explanations of the errors, for exemple) or can give information 
in the form of words or numbers. The student knows that he can- 
not change his answer without ils showing on the enclosed copy. 

Ill 
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NOTE ON REFERENCES 

The present report is the first in a series of three (issued as 
’’Didakometry’', Nos, 30, 32 and 33). The references have all been 
collected in the third report. Therefore, the reader is referred to 
the reference list in Didakometry, No. 33, 



